Deciding a metric when evaluating a ML project can be difficult.
From an engineer’s perspective, they might want to optimize, word-level accuracy or query-level accuracy. On the other hand, for a businessmen’s perspective, they’d rather focus on revenue and user-engagement.
It’s important to agree on metrics that both sides can be comfortable with.
