https://www.reddit.com/r/pics/comments/5oyhfy/salt_squared/dcn6dk1/
A simple copycat app that will listen for what you say and repeat it back.
npm install
npm link
react-native {run-ios || run-android} # NB asr and tts don't work in simulators
npm run lint
The experiment had a two-fold purpose:
- Proof of concept for in-app companion voice support using react native.
- Explore platform support for a retail kiosk assistant.
The experiment relied on platform-provided ASR and TTS services, and did not attempt to implement such itself. The implementation was simply a copy cat (perform Automated Speech Recognition on via a microphone, and repeat the ASR'd speech back via Text to Speech). No natural language understanding was attempted.
Unimplemented
Platform-supplied. Tested using Google Voice and Apple Siri.
Other native ASR options: Alexa on Android, Pocketsphinx.
Platform-supplied. Tested using Google's Android.speech.tts and Apple Speech
React Native, using React Native Voice and React Native TTS.
Other react options: React Native STT, React Native Speech, react-native-bluemix
| OS | ASR | TTS | Status | Devices |
|---|---|---|---|---|
| iOS 10, 11 | ✅ | ✅ | Fully Supported | iPhone 6S, iPad Mini 2 |
| Android 7, 8 | ✅ | ✅ | Fully Supported | Google Pixel |
| FireOS 5.4 | ✅ | ✅ | Android SpeechRecognizer unsupported because they want you to use AVS. Sideloaded Google Play + Google app adds Google ASR | Kindle Fire 7 |
| RTAndroid 7.1 | ❌ | ✅ | Audio system unsupported | Raspberry Pi 3 |
| Geek Till It Hertz 7.1.1 | ❌ | ✅ | Audio system unsupported | Raspberry Pi 3 |
| emteria.OS | ❌ | ✅ | Audio system unsupported | Raspberry Pi 3 |
| Android Things 0.5.1 | ❌ | ✅ | Voice system unsupported | Raspberry Pi 3 |
| Raspbian Linux | ❌ | ❌ | Audio system unsupported | Raspberry Pi 3 |
Copyright 2018 Pylon, Inc.
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.