Meet and optimization metrics
Different considerations will have different classification accuracy and running time
We can run time accuracy and combined into a whole evaluation index, such as cost cost = accuracy-0.5 * runningTime We value indicates both of which, of course, we can set a threshold value , such time may be less 100ms only consider accuracy.
Of course, may also be considered a false positive, for example, do a wake-up system, "hi, siri", in addition to considering the trigger precision word to say wake up, we can also consider the number of trigger words did not say wake up, in fact, here and recall investigation precision similar to the establishment of the number of errors within 24 hours only to wake up at most once.
Summarize what is to your attention several indicators combined into one, through a certain way to achieve the fully automated method of assessment, look at the combined index.