1 - Most small variations on A/B landing pages do not show conclusive uptick. You usually need to do drastic changes to see a big difference. I wonder if the managing one code it would be messy or is there a way to have two or more different files?
2 - Many organizations have a problem understanding how much better one form is performing if they have low volumes. Is there statistical presentations that with C confidence can tell A is better than B.
3 - Sometimes is great to do A/B/A or A/B/C does your tool provide that?
2) We rolled out two variants for the headline copy on airfoil.io, and even in our relatively small sample set (less than 2k uniques so far) we've seen a dramatic difference in conversion (25% vs 10%)
3) You can add additional test cases, and change probabilities, by editing the app's config.yml file. The relevant configuration might look like this:
variants:
a: 0.2
b: 0.2
c: 0.6Nice! Will your dashboard take the ratios to account when helping the user see which design is performing better and also show the confidence interval?
If it's free, say so. If it's not, you better definitely say so.
"Track with Dasboard"