Learning to Detect Shifts in Unstructured Data Streams via Monitoring-by-Betting
Continuous monitoring of generative AI systems requires detecting distribution shifts in the unstructured data they ingest and generate. Existing monitoring methods typically control false alarms by requiring the discrepancy measure used to detect shifts to be *pre-specified*. However, for unstructured data, pre-specif...
Siyu Zhou, Jia-Lin Ouyang, Fan Xia et al.
· 1 citation