Sorry to necro the thread, but the problem still persists using the latest package. This usually happens after I used unity built-in Microphone.Start function. The pattern usually looks like this:
Start speech recognizer -> stop -> start microphone (recording) -> stop -> start speech recognizer again -> error.
This is really frustrating since the only way to fix the speech recognizer is to restart the app.