These tests cant go on forever or else youll never test anything else

[email protected]

While we knew it was going to be tricky to thread the needle we set up an AB testing experiment for target CPA bidding to try and lower the CPA. As we got into it we realized that to hit our CPA metric Google only showed the ads for about  of the impressions we could have had. That was a dealbreaker for him so we turned the test off and found another way. ab testing examples  google ads experiment goals screenshot When you set up experiments in Google they even ask for two key metrics and what you plan to have happen.


You should be doing this for yourself and asking Are there any potential deal breakers for metrics that would require me to stop this test before its finished Consider your AB testing timeline Unfortunately sometimes Laos Phone Number Data AB tests have to come to an end without a clear winner. But on the flip side AB tests need to run for long enough to make sure you have enough data to make decisions on. Only the very largest of accounts could potentially make a decision after a single week of testing but even then it would have to be night and day for me to be onboard.



I usually recommend a minimum of two weeks for a test to run and a maximum of two months. Anything beyond that can be unmanageable and gets into a place where other factors could be causing the test to be invalidated. This means that regardless of which AB testing example you choose to run be sure that within two months your test will have enough data to decide with confidence if your hypothesis was correct.