Question 1

Who is it for?

Accepted Answer

Our A/B Testing services are ideal for companies that regularly conduct A/B Tests (a few per month) or plan to make A/B Testing a key focus in the upcoming year.

Question 2

How long does it take to develop and implement your A/B Testing tool?

Accepted Answer

It typically takes around 3 months to develop and implement.

Question 3

What capabilities will your A/B Testing tool provide us with?

Accepted Answer

Our A/B Testing tool offers several advanced capabilities, including: Handling outliers (winsorizing (capping at the 99.5th percentile) is the industry standard for managing outliers); Sequential Testing (the ability to stop a test early if it is clearly winning or if it doesn’t have a chance to win); Advanced Sub-Segment Analysis (automatically highlights sub-segments (e.g., tiers) that show a significant difference from the general trend); CUPED (enhances statistical power using pre-existing data, offering a more advanced before-and-after approach); SRM (reliability test designed to check if groups are balanced).

Question 4

How much do your services cost?

Accepted Answer

Our services are customized to meet your specific needs, so pricing varies between projects. For detailed information, please contact us.

Question 5

What does the workshop include?

Accepted Answer

Our six-hour workshop covers the fundamentals and theory of A/B Testing, practical tools, and real-life examples.

Question 6

When is the best time to onboard the A/B Testing specialist?

Accepted Answer

You should onboard an A/B Testing specialist if you conduct several A/B tests monthly or plan to focus on A/B Testing in the coming year to ensure optimal performance.

Question 7

What results can I expect from the tech stack audit?

Accepted Answer

You'll receive a comprehensive analysis of your current A/B Testing efforts, recommended tools, best practices, and a handover session for key points of contact. By the end of the audit, your team will be ready to integrate an A/B Testing tool.

Question 8

What results can I expect from the workshop?

Accepted Answer

By the end of the workshop, your team will understand A/B Testing basics, practical challenges, and solutions, and will be equipped to design and execute simple A/B tests.

Question 9

What results can I expect from the advanced A/B Testing tool?

Accepted Answer

You can expect to run 3 times more tests, reduce test run-time by 50-60%, cut analyst time per test by 75%, and achieve more reliable test results.

Question 10

Why choose you over doing it ourselves?

Accepted Answer

Bell is a boutique agency specializing in A/B Testing with extensive experience and knowledge across industries. Our best practices are trusted and used by top companies like Monday.com and Playtika. For more details, visit our Case Studies page.

Question 11

What do you need from us?

Accepted Answer

While we handle most of the work, we require access to your data, and an initial support from your Analytical team, to tailor our services to your needs.

Question 12

Do you assist in deciding whether to build or buy an A/B Testing solution?

Accepted Answer

Yes. Our Tech Stack Audit includes reviewing your current efforts, assessing relevant tools, and providing findings, best practices, and implementation advice.

Move on to advanced A/B Testing

Is your testing trustworthy? We train teams and implement state-of-the-art A/B testing methodologies, including parallel testing, sequential testing, CUPED and more, to help you scale your testing efforts, improve accuracy, and better understand the true impact of your actions.