{"id":17590,"date":"2021-05-17T17:59:53","date_gmt":"2021-05-17T17:59:53","guid":{"rendered":"https:\/\/productcollective.com\/?p=17590"},"modified":"2021-10-04T16:50:43","modified_gmt":"2021-10-04T16:50:43","slug":"how-to-experiment-on-your-product-2","status":"publish","type":"post","link":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/","title":{"rendered":"How to Experiment on Your Product"},"content":{"rendered":"<p>You probably know by now that you should run experiments to test your product ideas early and often. But you may still be wondering exactly how to actually do the experiments. Here are some resources to help you structure your product experiments, from approaches that do not require coding to others that are an 11 on the rigorous scale.<\/p>\n<p><b>A product manager\u2019s guide to experimentation. <\/b>Product Managers develop hypotheses on an almost daily basis. They develop hypotheses about new features, changes to UX, even the specific copy that best conveys to a customer what the customer should do next. Developing hypotheses without validating them can lead to some undesirable consequences. Alex Mitchell provides <a href=\"https:\/\/medium.com\/the-modern-product-manager\/a-product-managers-guide-to-experimentation-a8051551b691\">this guide to experimentation<\/a> to explain:<\/p>\n<ul>\n<li aria-level=\"1\">why you should test<\/li>\n<li aria-level=\"1\">how to know the difference between a good test and a bad test<\/li>\n<li aria-level=\"1\">how to establish a testing culture in your organization.<\/li>\n<\/ul>\n<p>(via <a href=\"https:\/\/twitter.com\/Amitch5903\">@Amitch5903<\/a>)<\/p>\n<p><b>How to design high-impact product experiments.<\/b> Running experiments is a valuable tool for product managers to validate ideas, de-risk releases and measure the impact of their work. Many good product teams still struggle with running experiments that are impactful to the business\u2019 key results and help them advance their understanding of their users. To help you make better use of experiments, Negar Mokhtarnia tackles <a href=\"https:\/\/productcoalition.com\/how-to-design-high-impact-product-experiments-a5f1352c1c85\">the principles that successful teams use to maximize their outcomes<\/a>.<\/p>\n<p>(via <a href=\"https:\/\/twitter.com\/pro_coalition\">@pro_coalition<\/a>)<\/p>\n<p><b>Why you need to do more product experiments (and how to do them right).<\/b> Product experiments can and will improve your customer activation rates, engagement levels, and ultimately user retention \u2013 so if you\u2019re not doing them, you\u2019re leaving money on the table.<\/p>\n<p>In this blog, the folks from Userpilot show <a href=\"https:\/\/userpilot.com\/blog\/product-experiment-how-to\/\">how product managers can design and run product experiments \u2013 without coding<\/a> \u2013 to enhance user experience in a data-driven way.<\/p>\n<p>(via <a href=\"https:\/\/twitter.com\/teamuserpilot\">@teamuserpilot<\/a>)<\/p>\n<p><b>The amazing value of early and cheap product experiments. <\/b>It\u2019s important to test your new product idea long before you feel ready. It\u2019s also easy to feel uncomfortable about running experiments until you\u2019ve done all the necessary due diligence. However the longer you wait to run tests, the more invested you are in the idea. <a href=\"https:\/\/medium.com\/product-management-and-innovation\/the-amazing-value-of-early-and-cheap-product-experiments-23e6f0d90220\">Caroline Parnell describes some ways<\/a> to test early product ideas cheaply and quickly.<\/p>\n<p>(via <a href=\"https:\/\/twitter.com\/caroline8425\">@caroline8425<\/a>)<\/p>\n<p><b>A practical guide to product experimentation. <\/b>You\u2019ve seen all the explanations as to why you should do product experiments and some explanations of how product experiments work. Hungry for more details that would make your data scientist proud? Yifei Huang has your back. He provides this<a href=\"https:\/\/towardsdatascience.com\/a-practical-guide-to-product-experimentation-f9a6252c0e9e\"> in-depth guide to structuring your product experiments<\/a> including some specific procedures to analyze the results.<\/p>\n<p>(via <a href=\"https:\/\/www.linkedin.com\/in\/yifeihuangdatascience\/\">yifeihuangdatascience<\/a>)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>You probably know by now that you should run experiments to test your product ideas early and often. But you may still be wondering exactly how to actually do the experiments. Here are some resources to help you structure your product experiments, from approaches that do not require coding to others that are an 11 [&hellip;]<\/p>\n","protected":false},"author":6,"featured_media":17577,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"inline_featured_image":false,"footnotes":""},"categories":[340],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Experiment on Your Product - Product Collective | Organizers of INDUSTRY: The Product Conference<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to Experiment on Your Product - Product Collective | Organizers of INDUSTRY: The Product Conference\" \/>\n<meta property=\"og:description\" content=\"You probably know by now that you should run experiments to test your product ideas early and often. But you may still be wondering exactly how to actually do the experiments. Here are some resources to help you structure your product experiments, from approaches that do not require coding to others that are an 11 [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Product Collective | Organizers of INDUSTRY: The Product Conference\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/productcollective\" \/>\n<meta property=\"article:published_time\" content=\"2021-05-17T17:59:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-10-04T16:50:43+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif\" \/>\n\t<meta property=\"og:image:width\" content=\"360\" \/>\n\t<meta property=\"og:image:height\" content=\"270\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/gif\" \/>\n<meta name=\"author\" content=\"Kent J McDonald\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kent J McDonald\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/\",\"url\":\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/\",\"name\":\"How to Experiment on Your Product - Product Collective | Organizers of INDUSTRY: The Product Conference\",\"isPartOf\":{\"@id\":\"https:\/\/productcollective.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif\",\"datePublished\":\"2021-05-17T17:59:53+00:00\",\"dateModified\":\"2021-10-04T16:50:43+00:00\",\"author\":{\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/1d2a0862706dd25cb859df898421cfc9\"},\"breadcrumb\":{\"@id\":\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#primaryimage\",\"url\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif\",\"contentUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif\",\"width\":360,\"height\":270},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/productcollective.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Experiment on Your Product\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/productcollective.com\/#website\",\"url\":\"https:\/\/productcollective.com\/\",\"name\":\"Product Collective | Organizers of INDUSTRY: The Product Conference\",\"description\":\"For people who build, launch and scale world-class software products.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/productcollective.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/1d2a0862706dd25cb859df898421cfc9\",\"name\":\"Kent J McDonald\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/f05af3c4d932a4dd567e445ee0e47cc9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/f05af3c4d932a4dd567e445ee0e47cc9?s=96&d=mm&r=g\",\"caption\":\"Kent J McDonald\"},\"description\":\"Kent J McDonald writes about and practices software product management. He has product development experience in a variety of industries including financial services, health insurance, nonprofit, and automotive. Kent practices his craft with a variety of product teams and provides just in time resources for product people at KBP.media and Product Collective. When not writing or product managing, Kent is his family\u2019s #ubersherpa, listens to jazz and podcasts (but not necessarily podcasts about jazz), and collects national parks.\",\"sameAs\":[\"https:\/\/www.kbp.media\",\"https:\/\/twitter.com\/kbpmedia\"],\"url\":\"https:\/\/productcollective.com\/author\/kentjmcdonaldgmail-com\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to Experiment on Your Product - Product Collective | Organizers of INDUSTRY: The Product Conference","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/","og_locale":"en_US","og_type":"article","og_title":"How to Experiment on Your Product - Product Collective | Organizers of INDUSTRY: The Product Conference","og_description":"You probably know by now that you should run experiments to test your product ideas early and often. But you may still be wondering exactly how to actually do the experiments. Here are some resources to help you structure your product experiments, from approaches that do not require coding to others that are an 11 [&hellip;]","og_url":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/","og_site_name":"Product Collective | Organizers of INDUSTRY: The Product Conference","article_publisher":"https:\/\/www.facebook.com\/productcollective","article_published_time":"2021-05-17T17:59:53+00:00","article_modified_time":"2021-10-04T16:50:43+00:00","og_image":[{"width":360,"height":270,"url":"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif","type":"image\/gif"}],"author":"Kent J McDonald","twitter_misc":{"Written by":"Kent J McDonald","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/","url":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/","name":"How to Experiment on Your Product - Product Collective | Organizers of INDUSTRY: The Product Conference","isPartOf":{"@id":"https:\/\/productcollective.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#primaryimage"},"image":{"@id":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#primaryimage"},"thumbnailUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif","datePublished":"2021-05-17T17:59:53+00:00","dateModified":"2021-10-04T16:50:43+00:00","author":{"@id":"https:\/\/productcollective.com\/#\/schema\/person\/1d2a0862706dd25cb859df898421cfc9"},"breadcrumb":{"@id":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#primaryimage","url":"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif","contentUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2021\/05\/giphy-4.gif","width":360,"height":270},{"@type":"BreadcrumbList","@id":"https:\/\/productcollective.com\/how-to-experiment-on-your-product-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/productcollective.com\/"},{"@type":"ListItem","position":2,"name":"How to Experiment on Your Product"}]},{"@type":"WebSite","@id":"https:\/\/productcollective.com\/#website","url":"https:\/\/productcollective.com\/","name":"Product Collective | Organizers of INDUSTRY: The Product Conference","description":"For people who build, launch and scale world-class software products.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/productcollective.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/productcollective.com\/#\/schema\/person\/1d2a0862706dd25cb859df898421cfc9","name":"Kent J McDonald","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/productcollective.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/f05af3c4d932a4dd567e445ee0e47cc9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f05af3c4d932a4dd567e445ee0e47cc9?s=96&d=mm&r=g","caption":"Kent J McDonald"},"description":"Kent J McDonald writes about and practices software product management. He has product development experience in a variety of industries including financial services, health insurance, nonprofit, and automotive. Kent practices his craft with a variety of product teams and provides just in time resources for product people at KBP.media and Product Collective. When not writing or product managing, Kent is his family\u2019s #ubersherpa, listens to jazz and podcasts (but not necessarily podcasts about jazz), and collects national parks.","sameAs":["https:\/\/www.kbp.media","https:\/\/twitter.com\/kbpmedia"],"url":"https:\/\/productcollective.com\/author\/kentjmcdonaldgmail-com\/"}]}},"_links":{"self":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts\/17590"}],"collection":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/comments?post=17590"}],"version-history":[{"count":0,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts\/17590\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/media\/17577"}],"wp:attachment":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/media?parent=17590"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/categories?post=17590"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/tags?post=17590"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}