{"id":103,"date":"2010-02-26T11:47:46","date_gmt":"2010-02-26T15:47:46","guid":{"rendered":"http:\/\/gregkrehbiel.com\/marketing\/?p=103"},"modified":"2010-02-26T11:47:46","modified_gmt":"2010-02-26T15:47:46","slug":"when-its-safe-to-stop-an-unfinished-optimizer-experiment","status":"publish","type":"post","link":"https:\/\/gregkrehbiel.com\/marketing\/2010\/02\/26\/when-its-safe-to-stop-an-unfinished-optimizer-experiment\/","title":{"rendered":"When it&#8217;s safe to stop an unfinished optimizer experiment"},"content":{"rendered":"<p>Sometimes an experiment just keeps dragging on because the difference between the winning and losing page(s) hasn&#8217;t passed Google&#8217;s criteria for significance. <\/p>\n<p>Generally speaking, I think it&#8217;s a good idea to keep going until Google announces a winner, but sometimes the pattern is clear, and you really want to move along to your next test, so it&#8217;s worth it to call it done. <\/p>\n<p>Here&#8217;s what I mean. <\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/gregkrehbiel.com\/marketing\/wp-content\/uploads\/2010\/02\/optimizer_experiment.gif\" alt=\"optimizer_experiment\" title=\"optimizer_experiment\" width=\"500\" height=\"107\" class=\"alignnone size-full wp-image-104\" srcset=\"https:\/\/gregkrehbiel.com\/marketing\/wp-content\/uploads\/2010\/02\/optimizer_experiment.gif 500w, https:\/\/gregkrehbiel.com\/marketing\/wp-content\/uploads\/2010\/02\/optimizer_experiment-300x64.gif 300w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/p>\n<p>I don&#8217;t think anything&#8217;s going to change in this horse race. <\/p>\n<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/gregkrehbiel.com\/marketing\/wp-content\/uploads\/2010\/02\/optimizer_experiment2.gif\" alt=\"optimizer_experiment2\" title=\"optimizer_experiment2\" width=\"500\" height=\"143\" class=\"alignnone size-full wp-image-105\" srcset=\"https:\/\/gregkrehbiel.com\/marketing\/wp-content\/uploads\/2010\/02\/optimizer_experiment2.gif 500w, https:\/\/gregkrehbiel.com\/marketing\/wp-content\/uploads\/2010\/02\/optimizer_experiment2-300x85.gif 300w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/p>\n<p>The winning page isn&#8217;t a slam dunk, it but it&#8217;s good enough to call this race over and move on to the next idea. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>Sometimes an experiment just keeps dragging on because the difference between the winning and losing page(s) hasn&#8217;t passed Google&#8217;s criteria for significance. Generally speaking, I think it&#8217;s a good idea to keep going until Google announces a winner, but sometimes the pattern is clear, and you really want to move along to your next test, &#8230;<\/p>\n<p><a href=\"https:\/\/gregkrehbiel.com\/marketing\/2010\/02\/26\/when-its-safe-to-stop-an-unfinished-optimizer-experiment\/\" class=\"more-link\">Continue reading &lsquo;When it&#8217;s safe to stop an unfinished optimizer experiment&rsquo; &raquo;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[],"class_list":["post-103","post","type-post","status-publish","format-standard","hentry","category-google-website-optimizer"],"_links":{"self":[{"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/posts\/103","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/comments?post=103"}],"version-history":[{"count":3,"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/posts\/103\/revisions"}],"predecessor-version":[{"id":108,"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/posts\/103\/revisions\/108"}],"wp:attachment":[{"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/media?parent=103"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/categories?post=103"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gregkrehbiel.com\/marketing\/wp-json\/wp\/v2\/tags?post=103"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}