Asking Smarter Questions: Targeted Active Preference Learning for Underspecified Rewards
An informed prior is built that targets preference queries at the features that need resolving, and each query is accompanied with an explanation that focuses the human's attention on exactly those features.