{"id":15690,"date":"2017-07-13T15:38:04","date_gmt":"2017-07-13T15:38:04","guid":{"rendered":"https:\/\/productcollective.com\/?p=15690"},"modified":"2019-06-17T04:11:39","modified_gmt":"2019-06-17T04:11:39","slug":"mvps-how-to-run-test-effective-experiments","status":"publish","type":"post","link":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/","title":{"rendered":"MVPs — How to Run & Test Effective Experiments"},"content":{"rendered":"

The 7 habits for running highly effective lean startup experiments.\u00a0<\/strong>Even the most celebrated scientists are not immune to cognitive biases. Ash Maurya quotes Richard P. Feyman who said\u00a0\u201cthe first principle is that you must not fool yourself and you are the easiest person to fool.\u201d Although a product manager need not go to the lengths required by the scientific community to ensure valid results, you still must vigourosly test your own assumptions.\u00a0Maurya teaches that you can develop habits<\/a>\u00a0that will help you do this on a continued basis. These include clearly defining expected outcomes from the start, accepting imperfect information sources, depending on quantitative data, and becoming adept at turning your assumptions into falisifiable hypotheses.<\/p>\n

A guide to validating product ideas with quick and simple experiments.\u00a0<\/strong>An effective experiment must include these four elements — an hypothesis, your riskiest assumption, the method, and a minimum criterion for success. So says Grace Ng,\u00a0who provides details on how to assemble each of these<\/a>. First, a customer-problem hypothesis is formed (a problem-solution hypothesis will be formed after it’s been validated), then your riskiest assumption will be identified for testing, then the method of testing<\/a> chosen, and finally your expected outcomes defined.<\/p>\n

Five pitfalls of running lean startup experiments.\u00a0<\/strong>In another article,\u00a0Grace outlines some of the pitfalls to look out for when running experiments<\/a>. She starts with one of the most striking — testing the wrong thing. In the effort to show progress, it’s easy to rush into an experiment without sufficient planning. The result is a poorly defined experiment and an MVP that is not a good representation of the solution you’re trying to test. Similarly, failing to keep the MVP lean, not defining your success criterion and asking the wrong questions will lead you down the wrong road.<\/p>\n","protected":false},"excerpt":{"rendered":"

The 7 habits for running highly effective lean startup experiments.\u00a0Even the most celebrated scientists are not immune to cognitive biases. Ash Maurya quotes Richard P. Feyman who said\u00a0\u201cthe first principle is that you must not fool yourself and you are the easiest person to fool.\u201d Although a product manager need not go to the lengths […]<\/p>\n","protected":false},"author":2,"featured_media":15683,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"inline_featured_image":false,"footnotes":""},"categories":[1],"tags":[],"yoast_head":"\nMVPs - How to Run & Test Effective Experiments - Product Collective | Organizers of INDUSTRY: The Product Conference<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"MVPs - How to Run & Test Effective Experiments - Product Collective | Organizers of INDUSTRY: The Product Conference\" \/>\n<meta property=\"og:description\" content=\"The 7 habits for running highly effective lean startup experiments.\u00a0Even the most celebrated scientists are not immune to cognitive biases. Ash Maurya quotes Richard P. Feyman who said\u00a0\u201cthe first principle is that you must not fool yourself and you are the easiest person to fool.\u201d Although a product manager need not go to the lengths […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/\" \/>\n<meta property=\"og:site_name\" content=\"Product Collective | Organizers of INDUSTRY: The Product Conference\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/productcollective\" \/>\n<meta property=\"article:published_time\" content=\"2017-07-13T15:38:04+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-06-17T04:11:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png\" \/>\n\t<meta property=\"og:image:width\" content=\"600\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Paul McAvinchey\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Paul McAvinchey\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/\",\"url\":\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/\",\"name\":\"MVPs - How to Run & Test Effective Experiments - Product Collective | Organizers of INDUSTRY: The Product Conference\",\"isPartOf\":{\"@id\":\"https:\/\/productcollective.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png\",\"datePublished\":\"2017-07-13T15:38:04+00:00\",\"dateModified\":\"2019-06-17T04:11:39+00:00\",\"author\":{\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/f34ceda9eb6237e864633ca033061c0b\"},\"breadcrumb\":{\"@id\":\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#primaryimage\",\"url\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png\",\"contentUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png\",\"width\":600,\"height\":400},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/productcollective.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"MVPs — How to Run & Test Effective Experiments\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/productcollective.com\/#website\",\"url\":\"https:\/\/productcollective.com\/\",\"name\":\"Product Collective | Organizers of INDUSTRY: The Product Conference\",\"description\":\"For people who build, launch and scale world-class software products.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/productcollective.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/f34ceda9eb6237e864633ca033061c0b\",\"name\":\"Paul McAvinchey\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/productcollective.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/PLnHr3Hu_400x400-150x150.jpg\",\"contentUrl\":\"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/PLnHr3Hu_400x400-150x150.jpg\",\"caption\":\"Paul McAvinchey\"},\"description\":\"For over 20 years, Paul has been building and collaborating on digital products with fast-growing startups and global brands, including AOL and WMS Gaming. Currently, he's a co-founder of Product Collective, a worldwide community of product people. Members collaborate on in the exclusive Member Hub, meet at INDUSTRY: The Product Conference, listen to Rocketship.fm, learn at Product Interviews and get a weekly newsletters that includes best practices in product management. In recent years he led business development at DXY, a leading product design firm in the Midwest, and product innovation at MedCity Media, a publishing startup acquired by Breaking Media in 2015.\",\"sameAs\":[\"https:\/\/twitter.com\/https:\/\/twitter.com\/yaboya\"],\"url\":\"https:\/\/productcollective.com\/author\/newindsum\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"MVPs - How to Run & Test Effective Experiments - Product Collective | Organizers of INDUSTRY: The Product Conference","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/","og_locale":"en_US","og_type":"article","og_title":"MVPs - How to Run & Test Effective Experiments - Product Collective | Organizers of INDUSTRY: The Product Conference","og_description":"The 7 habits for running highly effective lean startup experiments.\u00a0Even the most celebrated scientists are not immune to cognitive biases. Ash Maurya quotes Richard P. Feyman who said\u00a0\u201cthe first principle is that you must not fool yourself and you are the easiest person to fool.\u201d Although a product manager need not go to the lengths […]","og_url":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/","og_site_name":"Product Collective | Organizers of INDUSTRY: The Product Conference","article_publisher":"https:\/\/www.facebook.com\/productcollective","article_published_time":"2017-07-13T15:38:04+00:00","article_modified_time":"2019-06-17T04:11:39+00:00","og_image":[{"width":600,"height":400,"url":"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png","type":"image\/png"}],"author":"Paul McAvinchey","twitter_misc":{"Written by":"Paul McAvinchey","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/","url":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/","name":"MVPs - How to Run & Test Effective Experiments - Product Collective | Organizers of INDUSTRY: The Product Conference","isPartOf":{"@id":"https:\/\/productcollective.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#primaryimage"},"image":{"@id":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#primaryimage"},"thumbnailUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png","datePublished":"2017-07-13T15:38:04+00:00","dateModified":"2019-06-17T04:11:39+00:00","author":{"@id":"https:\/\/productcollective.com\/#\/schema\/person\/f34ceda9eb6237e864633ca033061c0b"},"breadcrumb":{"@id":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#primaryimage","url":"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png","contentUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2017\/07\/mvp.png","width":600,"height":400},{"@type":"BreadcrumbList","@id":"https:\/\/productcollective.com\/mvps-how-to-run-test-effective-experiments\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/productcollective.com\/"},{"@type":"ListItem","position":2,"name":"MVPs — How to Run & Test Effective Experiments"}]},{"@type":"WebSite","@id":"https:\/\/productcollective.com\/#website","url":"https:\/\/productcollective.com\/","name":"Product Collective | Organizers of INDUSTRY: The Product Conference","description":"For people who build, launch and scale world-class software products.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/productcollective.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/productcollective.com\/#\/schema\/person\/f34ceda9eb6237e864633ca033061c0b","name":"Paul McAvinchey","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/productcollective.com\/#\/schema\/person\/image\/","url":"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/PLnHr3Hu_400x400-150x150.jpg","contentUrl":"https:\/\/productcollective.com\/wp-content\/uploads\/2020\/12\/PLnHr3Hu_400x400-150x150.jpg","caption":"Paul McAvinchey"},"description":"For over 20 years, Paul has been building and collaborating on digital products with fast-growing startups and global brands, including AOL and WMS Gaming. Currently, he's a co-founder of Product Collective, a worldwide community of product people. Members collaborate on in the exclusive Member Hub, meet at INDUSTRY: The Product Conference, listen to Rocketship.fm, learn at Product Interviews and get a weekly newsletters that includes best practices in product management. In recent years he led business development at DXY, a leading product design firm in the Midwest, and product innovation at MedCity Media, a publishing startup acquired by Breaking Media in 2015.","sameAs":["https:\/\/twitter.com\/https:\/\/twitter.com\/yaboya"],"url":"https:\/\/productcollective.com\/author\/newindsum\/"}]}},"_links":{"self":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts\/15690"}],"collection":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/comments?post=15690"}],"version-history":[{"count":0,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/posts\/15690\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/media\/15683"}],"wp:attachment":[{"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/media?parent=15690"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/categories?post=15690"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/productcollective.com\/wp-json\/wp\/v2\/tags?post=15690"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}