undefined | Better HN

0 pointsdtgriscom3y ago0 comments

There are facts about human behavior which can only be learned by actually testing them. People are complex in ways that you, whilst sitting at your keyboard, cannot figure out.

0 comments

tornato73y ago

All which can be learned through focus groups and internal feedback, no need to further confuse and frustrate your users.

szundi3y ago

After you have the engine running, the marginal cost of an A/B is probably smaller than a focus group test. So if you really believe in focus groups for the results and you are also ambitious enough - probably this means go for A/B.

Disclaimer: just thinking, not knowing the costs

tornato73y ago

Definitely agree, though I think the point of this thread is we don’t know the “true cost” of A/B testing in terms of long-term lost user engagement.

Have we done an A/B test for A/B testing where we test A/B testing…

fshbbdssbbgdd3y ago

It’s very common to think something is a good idea based on focus groups and internal feedback and then learn it’s a bad idea from launching it (or running an AB test).

j / k navigate · click thread line to collapse

0 comments

tornato73y ago

All which can be learned through focus groups and internal feedback, no need to further confuse and frustrate your users.

szundi3y ago

Disclaimer: just thinking, not knowing the costs

tornato73y ago

Definitely agree, though I think the point of this thread is we don’t know the “true cost” of A/B testing in terms of long-term lost user engagement.

Have we done an A/B test for A/B testing where we test A/B testing…

fshbbdssbbgdd3y ago

It’s very common to think something is a good idea based on focus groups and internal feedback and then learn it’s a bad idea from launching it (or running an AB test).

j / k navigate · click thread line to collapse