FrankenReport: Early Exiting in Long-Form Generation Using Expected Value of Computation
FrankenReport, an interface for long-form knowledge-seeking report generation that supports adaptive early exiting per section, is presented, an interface for long-form knowledge-seeking report generation that evaluates intermediate outputs during generation and predicts whether further targeted computation will yield...