Learnings and Pitfalls from AI-Assisted A/B Experimentation at Scale
A/B testing underpins product decisions by providing trustworthy, reproducible quantification of proposed changes'effects. Growing large language model (LLM) capabilities have motivated efforts to automate experimentation workflows. Yet LLMs are nondeterministic and prone to hallucination, properties that conflict with...
Brett Daley, I. Gorbachev, Anubhav Natani et al.
· 0 citations