Audio recording while using Mobile Speech Recognizer

[yosi1202]

I am using “Mobile Speech Recognizer”, and it works great,
but i am trying to record audio while the speech recognizer is on and i doesnt work,
is there a way to fix it? is there a way to use recorded audio (an audio clip object)
to generate text with speech recognizer?

[Piotr]

How are you trying to record audio?
There’s no supported way to use recorded clip as an input for recognition.

[yosi1202]

Microphone.Start(“”, true, 20, 44100);

It works when not trying to recognize speech

[Piotr]

Yeah, I think it might be in conflict with plugin recording audio at the same time.
My idea for fixing that is adding a callback which will pass recorded chunks to C# callback, something like OnAudioRecorded(audioChunk: byteArrayOrSomething).

But… that would take some time. Would be able to contribute and add this feature on any platform?

[yosi1202]

sorry i didnt understand the solution, can you explain?

[Piotr]

Internally plugin receives audio chunks as a byte array and sends it to recognition engine and then send result to Unity. There could be another optional callback which would take those bytes before sending to engine so anyone from outside could use it measure volume, convert to mp3 etc.

[yosi1202]

OK, but how do I do that? SpeechRecognizer has only start and stop recording function and no callback for what you say, I dont see any options to change what is sent to the recognition engine or catch it before sending, if you could please explain what functions or callback can I us, there is nothing related to it in the code or the documentations

[Piotr]

I am asking if you would be able to add this feature to at least one platform.
I could share source code with you and if that’s an option I would be able to cover 2nd platform.

[yosi1202]

That is what I am trying to do, but right now I dont have much to work with

[yosi1202]

???

[Piotr]

For external viewers: yosi1202 was given access to Android project so he can start work on adding this feature.

[chienbnb00859]

Has this problem been resolved ?, I am also having difficulty in Audio recording while using Mobile Speech Recognizer

[Author]

Posts