A/B testing in Custobar
There are three fields in Custobar that are used for testing campaigns: split_ab allows you to do ab testing with two groups of equal size. split_abc with 3 groups of equal size, and split_abcd with 4 groups.
When a customer is created in Custobar, they are placed in one of the groups A or B so that the groups are always roughly the same size. They are also placed in one of the A B or C groups and A B C or D groups.
Now the complicated part: Although they use the same letters, the group a from split_ab is not the same as the group a from split_abc or split_abcd.
That is because group A in split_ab represents 50% of all customers at any given time. Group A in split_abcd is 25% of all customers at any given time. So to keep the percentage correct, some customers from group A in split_ab will also belong to group B, C or D in split_abcd.
That is the technical part. In practice, if you want to do some ab testing, just create two drafts with the content of your choosing, and for the target audience, do your normal segmentation with the queries and filters of your choosing. When you are done, just add to the segmentation the field split_ab and choose group “a” for one campaign, and do the same and choose group “b” for the other. You can now activate both campaigns and compare the statistics depending on the criteria you are testing.
Repeat those steps with more drafts for abc or abcd testing.
We strongly suggest testing only one factor (difference in content, headlines or scheduling) at a time to make sure the results are accurate.
If you have any questions, please contact Custobar support.
Flow
User Guide
Main views
- Suomalainen Kirjakauppa knows their customer with the help of the right CDP
- Sales heat map
- Pin code for in-store interface
- In-store interface
- Cohort Analysis
- Customer page symbols
- Products view
- Events view
- Dashboard view
- Customer 360° view layout configuration
- Customers view
- Customer change history
- The new search blocks
- Sales view
Video tutorials
- Flow video tutorial
- Facebook Ads integration tutorial video
- Google Ads Customer Match integration tutorial video
- Email campaign video tutorial
- Email content editor video tutorial
- SMS campaign video tutorial
- Template designer video tutorial
Email campaigns
- Call to action email module
- Link an Unsubscribe page to a mailing list
- How to purchase email or SMS credits?
- UTM Tags
- Custom utm_source tags
- How to add coupon codes to your campaign
- Customer satisfaction survey
- Unsubscribe survey & report
- Email sender authentication
- IP address warmup
- Product recommendations
- Create your own template with the template designer
- How to use Custobar stickers on product images
- Creating and editing a template
- Audiences in Custobar
- Create a campaign for a fixed recipient
- Creating an email campaign action — Whole process
- Campaign statistics view
- A/B testing in Custobar
- Email campaign video tutorial
- Email content editor video tutorial
- Template designer video tutorial
Banner campaigns
- Audiences in Custobar
- Create a campaign for a fixed recipient
- Campaign statistics view
- Setting up banner campaigns
SMS campaigns
- How to purchase email or SMS credits?
- Audiences in Custobar
- Create a campaign for a fixed recipient
- Campaign statistics view
- Creating an SMS campaign action
- SMS campaign video tutorial
- Two-way SMS
External campaigns
- Facebook Ads integration tutorial video
- Facebook Ads Manager integration
- Google Ads Customer Match integration tutorial video
- Google Ads Customer Match integration
- Audiences in Custobar
- External campaign configuration for data extraction
- Create a campaign for a fixed recipient
- Creating an External Campaign Action
- Campaign statistics view
Push campaigns
- How to set up a push action
- Audiences in Custobar
- Create a campaign for a fixed recipient
- Campaign statistics view
Add-ons
- Facebook Ads Manager integration
- Google Ads Customer Match integration
- How to add coupon codes to your campaign
- Product recommendations
- How to use Custobar stickers on product images
Data integrations
Importing and updating data
- Data import file templates
- Setting up Custobar - Zapier integration
- Promoting customers
- How to send events from a website
- Deleting customers in bulk
- Adding, updating and removing customer's mailing lists
- Adding a new user to Custobar
- Updating data of multiple customers at once
Marketing and advertising integrations
- Facebook Ads integration tutorial video
- Facebook Ads Manager integration
- Google Ads Customer Match integration tutorial video
- Google Ads Customer Match integration