This website was archived on July 21, 2019. It is frozen in time on that date.

Sonya Mann's active website is Sonya, Supposedly.

Is A/B Testing Worth It for Bootstrappers?

“Companies that use innovative and data-driven analytical approaches to marketing are found to have the highest success rate of conversions on their website.” — WeSpotlight

In case you’re not familiar with A/B testing, here’s a quick definition from Visual Website Optimizer: “A/B testing (sometimes called split testing) is comparing two versions of a web page to see which one performs better. You compare two web pages by showing the two variants (let’s call them A and B) to similar visitors at the same time.” Then you record how those website visitors behaved differently based on which version they were shown.

After analyzing the data, you keep whichever design performed better, discard the other one, and start the process again with a new tweak. Over time, you iterate toward the Holy Grail: a perfect landing page that converts 100%! Jkjk, that’s impossible — but you can certainly improve your baseline. A/B testing is a simple way to ensure that the changes you make are doing what they’re supposed to.

This is obviously a very clever idea. Equally obviously it takes time and energy to pull it off. If you have limited resources and you’re forced to be ruthless about where you focus your effort, is it worth it to A/B test? You have to come up with website variations, deploy your A/B testing tool(s), and then wait for enough visitors to be processed. The concept is simple, but the execution is often lacking. From the Kissmetrics blog:

“A/B tests are designed to imitate scientific experiments, but most marketers running A/B Tests do not live in a world that is anything like a lab at a university. The stumbling point is that people running A/B tests are supposed to wait and not peak at the results until the test is done, but many marketers won’t do that.”

As a bootstrapping entrepreneur, maybe with a day job to balance, it’s important to evaluate where your energy will have the highest impact. Of course, “is it worth it to A/B test?” is one of those trick questions: the real answer is that you have to weigh your priorities and decide for yourself.

This issue is on my mind right now because I’m personally debating whether I can justify spending time and effort A/B testing the Product Communication Basics landing page. And I think the answer is… no. Here’s why: opportunity cost.

Investopedia handily defines opportunity cost as “the cost of an alternative that must be forgone in order to pursue a certain action. Put another way, the benefits you could have received by taking an alternative action.” Right now I don’t even have enough website traffic to get statistically reliable results from an A/B test! So I’m gonna work on that first. Hi Reddit ;)


Do you need a practical guide to writing sweet landing page copy? Check out Product Communication Basics.

The How & Why of Premium Pricing: Anxiety Included for No Extra Charge!

Update: I decided to cut the scope of the workbook and hence cut the price as well, but the reasoning remains the same.


“There’s one easy way to find out what customers think about prices. By selling them things.” — Tom Whitwell

I’m reaching the stage where I ask people to hand over their money. Frankly, it’s terrifying. What if I fail at the very thing I’m trying to teach? A big part of me wants to pretend that I’m sure the launch will be a slam dunk, that I’m abso-freaking-lutely confident 💪🏀👍 But a bigger part of me wants to be honest about my thought process and my anxieties.

Javon McCrea dunking. Photo by Chad Cooper.
Javon McCrea dunking. Photo by Chad Cooper.

Value > Dollars

When it officially launches, Product Communication Basics will cost $34.99. That’s definitely more expensive than the average ebook. Heck, Amazon wants to cap prices at $9.99! And yet I think $34.99 is justified; PCB is more of a guided do-it-yourself consulting session than it is a standard book. Like I wrote on the landing page:

“Consider this: if you hired an excellent copywriter, you’d end up paying them $50 per hour at the very least, and you’d spend most of that time just trying to communicate your vision. How much is your time worth?”

I chose this framing for a very specific reason. Price is 100% a function of perceived value. The time, effort, and cost of materials are close to irrelevant — it’s all about what the product will do for the customer. Bootstrapping guru Amy Hoy quips, “Don’t get snared into a price conversation. Turn it into a value investigation, instead.”

If people anchor on how much hiring a consultant costs — if they perceive the value of Product Communication Basics in those terms — hopefully they won’t worry about paying $20 more than usual for an ebook. My guess is that the kind of person I want to sell to will understand my point and find it compelling. Hoy has also written that people who pay money for things “value their time more than their money.” Why? Because they understand comparative advantage and opportunity cost.

If you’re a high-impact professional, especially an entrepreneur, then spending your time compiling a bunch of information into a useful format is not worth it, and your end result won’t be on par with what domain experts can offer. Any hours you might spend researching are hours that you could have spent improving your own product, which has an order of magnitude greater effect in terms of 1) saving your future time and 2) multiplying your future funds.

Patrick McKenzie, a former bootstrapper who is now CEO of Starfighter, similarly exhorts people building products to value their time highly:

“Instead of [trying to do more with the limited time you have], build time assets: things which will save you time in the future. Code that actually does something useful is a very simple time asset for programmers to understand: you write it once today, then you can execute it tomorrow and every other day, saving you the effort of doing manually whatever it was the code does. Code is far from the only time asset, though: systems and processes for doing your work more efficiently, marketing which scales disproportionate to your time, documentation which answers customers’ questions before they ask you, all of these things are assets.” (Emphasis in original.)

An effective product pitch is a great example of a marketing asset that scales — once you’ve found the essence of your value proposition, you can and should use it again and again on your website, in emails, in advertising, etc. Do the labor once and reap the rewards continually.

Looking Forward

I think I’ve made a solid argument that my potential customers will save money if they buy from me, because otherwise they’d have to pay a copywriter much more or waste their own time figuring out an approach. I’ve also made the argument that my customers will earn more money in the first place.

But… I’m still nervous. What if the people in search of marketing resources don’t agree with my reasoning? What if no one orders the book? Realistically, in that case I’ll lower the price and try again. I’m a big believer in ~markets~ and I’ll listen to the signals as they come.

Another point from Amy Hoy: “You’re afraid of asking for money, so you think the thing to do is to ask for only a little. It feels safer.” Welp, she’s right. In the grand scheme of things, $34.99 is not a huge amount of money. You can drop that much on brunch or jeans from Target. And yet I’m still scared that it will seem like a ludicrous ask.


What are you waiting for? Assuage my fears and go buy Product Communication Basics!

Sign up for my newsletter to stay abreast of my new writing and projects.

I am a member of the Amazon Associates program. If you click on an Amazon link from this site and subsequently buy something, I may receive a small commission (at no cost to you).