Distributional Metrics for Evaluating Spoken Conversational Systems
The Conversational Distribution Score (CDS) is introduced, which compares distributions of conversational behaviour using human conversations as a reference, and how many minutes and conversations are required before rankings stabilize is examined.