One Policy, Many Styles: Where to Aggregate Preferences for Steerable Humanoid Control?
This evaluation combines Preference Reward Responsiveness (PRR) with coverage and utility metrics to compare reward-level, advantage-level, loss-level, and PCGrad-based aggregation across two humanoid-control frameworks.