Episode #650
How Often Should You Run Experiments?
May 12, 2018
In episode #650, Eric and Neil discuss how often you should be running experiments. Tune in to hear when, why, and how you should be running experiments.
TIME-STAMPED SHOW NOTES:
- [00:27] Today’s Topic: How Often Should You Run Experiments?
- [00:39] Eric thinks you should be running experiments every single week.
- [00:55] For Eric’s site, they run experiments on the site itself and the business.
- [01:05] They use North Star to run these experiments and Eric loves the Leaderboard function.
- [01:45] The more experiments you run, the better off you are.
- [01:52] However, it’s hard to run experiments when you don’t have enough traffic.
- [02:04] Once you get enough conversion points (500 per month), you can run 1-2 experiments per month because you will be able to see micro and macro conversions.
- [02:28] A micro conversion could be someone going to your checkout page.
- [02:36] A macro conversion could be more sales in general.
- [03:00] If you’re a small business, it’s ok to track micro conversions only.
- [03:22] In the short run, if you can’t optimize for conversions and sales, your experimentation should be around traffic generation. Use Similar Web, SEMRush, and AHREFS.
- [04:15] Managing Oneself is a short booklet that talks about the importance of feedback analysis.
- [05:14] There isn’t one experiment that will make you a major success, but rather a lot of little things that add up.
- [05:36] Make sure to break down the experiments to focus on tiny aspects of your business.
- [06:28] Running experiments over time lets you see what your strengths and weaknesses are.
- [06:44] That’s all for today!
- [06:46] Go to Singlegrain.com/Giveway for a special marketing tool giveaway!
Leave some feedback:
- What should we talk about next? Please let us know in the comments below.
- Did you enjoy this episode? If so, please leave a short review.
Connect with us:
Discover Latest Episodes
Episode
The Truth About Corporate AI Spending (It’s Not What You Think)
October 23, 2026
Growth Newsletter: https://levelingup.beehiiv.com/subscribe...
Episode
The Rule of 7 Is Dead: Why You Need 28 Touches Now
October 22, 2026
Eric and Neil say the rule of 7 has grown toward the rule of 28, and that buyers touch a brand 8 times for a sub-$100 B2C buy and 23 times at $10K-plus. A gelato shop stranger who knew them from diffe...
Episode
Do NOT Sleep on X Money!
October 20, 2026
Eric and Neil start with X Money, which pays 3% cash back and 6% interest, and argue that the offer is under marketed and would get more people investing. They test an AI-written blog post on a client...