Predicting When Machine Learning Models Fail
UCL - Bloomberg - London Feb. 2019
ML models fail due to Domain shift. However, Domain-shift detection metrics are model and task-dependent
In this Talk I present:
Task dependent modifications to domain-shift detection metrics
A method to predict the performance drop of ML models
Cheap & Fast without target domain annotations
Accurate ± 2.15% Sentiment analysis & ± 0.89 % POS tagging
