Speech Recognition on ODROID

n2fan · Post by **n2fan** » Tue Jan 12, 2021 7:09 pm

server on N2 works fine; I was able to decode max 3 processes in parallel in real time.

nshmyrev · Post by **nshmyrev** » Tue Jan 12, 2021 7:11 pm

> thanks, will try the server today. did you make some tests how many channels can be processed in parallel on Intel hardware or any other devices/processors?

Modern i7 server 8 cores processes up to 20 processes in parallel, Odroid will process less of course.

> vosk-server/client-samples/python/tts-test.py is it a text to speech engine included?

It is not fully functional, you can try https://github.com/TensorSpeech/TensorFlowTTS instead

n2fan · Post by **n2fan** » Tue Jan 12, 2021 8:28 pm

must revise.
It's not that simple with the server;

current state: if the system is constantly running, Odroid can't even process one channel in real time. I have the impression that the processing speed depends on the audio. If there is a lot of noise or music in the background, performance goes down. It works faster if there is only speech without background noise. All cores are not 100% utilised with the server.

it may also be that other processes have an impact, so that processing is not uniform. Would be very grateful for other opinions/impressions. If TTS is added, Odroid is overloaded (current state).

nshmyrev · Post by **nshmyrev** » Tue Jan 12, 2021 9:01 pm

n2fan wrote: ↑
Tue Jan 12, 2021 8:28 pm
current state: if the system is constantly running, Odroid can't even process one channel in real time. I have the impression that the processing speed depends on the audio. If there is a lot of noise or music in the background, performance goes down. It works faster if there is only speech without background noise. All cores are not 100% utilised with the server.

Which model is that? With lightweight model it should be realtime.

n2fan · Post by **n2fan** » Tue Jan 12, 2021 9:55 pm

I tested with the bigger model (vosk-model-small-en-us-0.15, vosk-model-en-us-daanzu-20200905-lgraph) because smaller model has not worked;

odroid@odroid:~/vosk/vosk-server/vosk-server/websocket$ python3 ./asr_server.py /home/odroid/vosk/vosk-api/python/example/model
LOG (VoskAPI:ReadDataFiles():vosk/model.cc:194) Decoding params beam=10 max-active=3000 lattice-beam=2
LOG (VoskAPI:ReadDataFiles():vosk/model.cc:197) Silence phones 1:2:3:4:5:6:7:8:9:10
LOG (VoskAPI:RemoveOrphanNodes():nnet-nnet.cc:948) Removed 0 orphan nodes.
LOG (VoskAPI:RemoveOrphanComponents():nnet-nnet.cc:847) Removing 0 orphan components.
LOG (VoskAPI:CompileLooped():nnet-compile-looped.cc:345) Spent 0.0968211 seconds in looped compilation.
LOG (VoskAPI:ReadDataFiles():vosk/model.cc:221) Loading i-vector extractor from /home/odroid/vosk/vosk-api/python/example/model/ivector/final.ie
LOG (VoskAPI:ComputeDerivedVars():ivector-extractor.cc:183) Computing derived variables for iVector extractor
LOG (VoskAPI:ComputeDerivedVars():ivector-extractor.cc:204) Done.
LOG (VoskAPI:ReadDataFiles():vosk/model.cc:251) Loading HCL and G from /home/odroid/vosk/vosk-api/python/example/model/graph/HCLr.fst /home/odroid/vosk/vosk-api/python/example/model/graph/Gr.fst
LOG (VoskAPI:ReadDataFiles():vosk/model.cc:273) Loading winfo /home/odroid/vosk/vosk-api/python/example/model/graph/phones/word_boundary.int
ERROR (VoskAPI:MaybeCreateResampler():online-feature.cc:99) Sampling frequency mismatch, expected 16000, got 8000
Perhaps you want to use the options --allow_{upsample,downsample}
terminate called after throwing an instance of 'kaldi::KaldiFatalError'
what(): kaldi::KaldiFatalError
Aborted (core dumped)
odroid@odroid:~/vosk/vosk-server/vosk-server/websocket$

ffmpeg provides 16000 samples

Output #0, wav, to '/tmp/voice.wav':
Metadata:
Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 16000 Hz, mono, s16, 256 kb/s
Metadata:
encoder : Lavc58.35.100 pcm_s16le
av_interleaved_write_frame(): Broken pipe

the same result was with the included test file - python3 ./test.py ./test16k.wav

nshmyrev · Post by **nshmyrev** » Wed Jan 13, 2021 2:10 am

n2fan wrote: ↑
Tue Jan 12, 2021 9:55 pm
I tested with the bigger model (vosk-model-small-en-us-0.15, vosk-model-en-us-daanzu-20200905-lgraph) because smaller model has not worked;
ERROR (VoskAPI:MaybeCreateResampler():online-feature.cc:99) Sampling frequency mismatch, expected 16000, got 8000
Perhaps you want to use the options --allow_{upsample,downsample}
terminate called after throwing an instance of 'kaldi::KaldiFatalError'
what(): kaldi::KaldiFatalError
Aborted (core dumped)
odroid@odroid:~/vosk/vosk-server/vosk-server/websocket$

Run like this: