News Instruction

Finally! A/B Testing arrives to ZonMaster

I know, I know! You’ve been asking for a way to do split testing for some time! Finally we have the first stage of our solution in place.

What It Is

You can set a template to go out to all orders or to odd numbered orders or even numbered orders. Amazon pretty much splits these order numbers 50/50 and we’ve done a lot of testing – this does seem to be a good way to do the splitting. By sending one template to odd numbered orders and another to even numbered orders you can see which is more effective.

Split testing (also referred to as A/B testing or multivariate testing) is a method of conducting controlled, randomized experiments with the goal of improving a website metric, such as clicks, form completions, or purchases. Incoming traffic to the website is distributed between the original (control) and the different variations without any of the visitors knowing that they are part of an experiment. The tester waits for a statistically significant difference in behavior to emerge. The results from each variation are compared to determine which version showed the greatest improvement.

How To Use It

What we recommend is to set up two almost identical templates (you can duplicate a template by using the ‘Clone’ button when you’re viewing a template). Set one of the templates to be an ‘A’ template and the other to be a ‘B’ template.

Then change something like the subject line. Changing the subject line in one template and leaving the other alone will, then looking at the open rates, will let you see which subject line is more affective.

Or leave the subject line and change the call to action in the content of the email.

Change only 1 thing between emails – otherwise you don’t know what caused the difference results!

Where to set it

The ‘A/B Selector’ is available while editing a template.


Automatic Blacklisting

Over the past few days we’ve been sneaking out some new features. One of them is Automatic Blacklisting of Customers.

What it does

A few of you have asked for this – some way of automatically blacklisting customers in certain situations so you don’t have to worry about them getting ‘canned’ emails that might not be appropriate. Now you can do that. We offer four options: to blacklist the customer when they’ve:

  • Gotten a refund
  • Returned an item
  • Left a negative review
  • Left negative seller feedback

Once you make the setting that customer will never get another email from you via ZonMaster!

Where to find it

These settings apply to each Amazon Merchant account (‘store’ in ZonMaster-speak). So go to your stores listing page here. Then select each store. You’ll see a section on that page similar to the one at the top of this blog post where you can make each setting.

Use Caution

Be aware that by blacklisting a customer they will never get another email via ZonMaster – even if they make a new purchase. This may not be what you want. We do also have the ability to stop sending on an order (go to an orders page and click the ‘Stop Sending for this Order’ button), and of course on every template you can choose one or many ‘Stop On’ options. So you’ve got lots of choices.