Example of Automatic Speech Recognition without Pickup UI - Huawei Developers

More information like this, you can visit HUAWEI Developer Forum​
Original link: https://forums.developer.huawei.com/forumPortal/en/topicview?tid=0202351447289070169&fid=0101187876626530001
Automatic Speech Recognition
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Service Introduction
Automatic speech recognition (ASR) can recognize speech not longer than 60 seconds and convert the input speech into text in real time. This service uses industry-leading deep learning technologies to achieve a recognition accuracy of over 95%. Currently, Mandarin Chinese (including Chinese-English bilingual speech), English, French, German, Spanish, and Italian can be recognized.
Precausions
Currently, ASR is available only on Huawei phones.
ASR depends on the on-cloud API for speech recognition. During commissioning and usage, ensure that the device can access the Internet.
Integrating the Automatic Speech Recognition Service
You can integrate the automatic speech recognition (ASR) service in either of the following modes:
Integrate the ASR plug-in
Integrate the ASR SDK
The SDK provides only the basic ASR services, and you need to develop the speech pickup UI by yourself.
The sample code for integration through SDK is as follows:
Code:
dependencies{
// Import the ASR SDK.
implementation 'com.huawei.hms:ml-computer-voice-asr:2.0.1.300'
}
Development Process
Before API developement, you need to create custom layout based on your requirements. Check the below code
Code:
<?xml version="1.0" encoding="utf-8"?>
<RelativeLayout xmlns:android="http://schemas.android.com/apk/res/android"
xmlns:app="http://schemas.android.com/apk/res-auto"
android:layout_width="match_parent"
android:layout_height="match_parent"
android:background="#fff">
<androidx.cardview.widget.CardView
android:id="@+id/card_listen"
android:visibility="gone"
android:layout_width="match_parent"
android:layout_height="match_parent"
app:cardBackgroundColor="#f1f1f1"
app:cardElevation="5dp">
<RelativeLayout
android:layout_width="match_parent"
android:layout_height="match_parent"
android:layout_margin="@dimen/dimen_10">
<ImageView
android:id="@+id/img_close_listen"
android:layout_width="@dimen/dimen_50"
android:layout_height="@dimen/dimen_50"
android:padding="@dimen/dimen_10"
android:src="@drawable/close_pc" />
<TextView
android:id="@+id/txt_listening"
android:layout_width="wrap_content"
android:layout_height="wrap_content"
android:layout_below="@id/img_close_listen"
android:layout_marginTop="@dimen/dimen_20"
android:text="Listening..."
android:textColor="#000"
android:textSize="18sp"
android:textStyle="bold" />
<ImageView
android:id="@+id/img_listening_mic"
android:layout_width="wrap_content"
android:layout_height="wrap_content"
android:layout_alignParentBottom="true"
android:src="@drawable/listening_mic" />
<RelativeLayout
android:id="@+id/rl_try_again"
android:layout_width="match_parent"
android:layout_height="wrap_content"
android:visibility="gone"
android:layout_alignParentBottom="true"
android:layout_margin="@dimen/dimen_50">
<com.google.android.material.floatingactionbutton.FloatingActionButton
android:id="@+id/fab_mic"
android:layout_width="wrap_content"
android:layout_height="wrap_content"
android:layout_centerHorizontal="true"
android:backgroundTint="#fff"
android:src="@drawable/mic_pc" />
<TextView
android:id="@+id/txt_tap_micro"
android:layout_width="wrap_content"
android:layout_height="wrap_content"
android:layout_below="@id/fab_mic"
android:layout_centerHorizontal="true"
android:layout_marginTop="@dimen/dimen_20"
android:text="Tap microphone to try again"
android:textColor="#000"
android:textSize="12sp"
android:textStyle="bold" />
</RelativeLayout>
</RelativeLayout>
</androidx.cardview.widget.CardView>
</RelativeLayout>
1. Set the ApiKey
Code:
private void setApiKey() {
// AGConnectServicesConfig config = AGConnectServicesConfig.fromContext(getApplication());
// MLApplication.getInstance().setApiKey(config.getString("client/api_key"));
MLApplication.getInstance().setApiKey(getString(R.string.api_key));
}
2. Initialize ASR
Code:
private void initASR() {
speechRecognizer = MLAsrRecognizer.createAsrRecognizer(this);
speechRecognizer.setAsrListener(this);
}
3. Implement a speech recognition result listener callback
Code:
@Override
public void onResults(Bundle bundle) {
Log.e(TAG + "onResults", "onResults");
final String speechResult = bundle.getString("results_recognized");
if (speechResult != null && !speechResult.equals("")) {
txtListeningText.setTextColor(Color.RED);
txtListeningText.setText(speechResult);
Log.e(TAG + " Speech Text", speechResult);
Handler handler = new Handler();
handler.postDelayed(new Runnable() {
@Override
public void run() {
Intent intent = new Intent(SearchActivity.this, MapActivity.class);
intent.putExtra("LISTEN_DATA", speechResult);
setResult(Activity.RESULT_OK, intent);
finish();
stopSpeechListener();
}
}, 2000);
}
}
@Override
public void onRecognizingResults(Bundle bundle) {
Log.e(TAG + "onRecognizingResults", "onRecognizingResults");
}
@Override
public void onError(int i, String s) {
if (s != null)
Toast.makeText(SearchActivity.this, TAG + "onError" + s, Toast.LENGTH_SHORT).show();
}
@Override
public void onStartListening() {
txtListeningText.setText("Listening...");
}
@Override
public void onStartingOfSpeech() {
Log.e(TAG + "onStartOfSpeech", "Speech Started");
}
@Override
public void onVoiceDataReceived(byte[] bytes, float v, Bundle bundle) {
}
@Override
public void onState(int i, Bundle bundle) {
Log.e(TAG + "onState", String.valueOf(i));
}
4. Set recognition parameters and call startRecognizing to start speech recognition
Code:
private void startCustomASR() {
if (checkPermission()) {
countDown();
rlTryAgain.setVisibility(View.GONE);
imgListening.setVisibility(View.VISIBLE);
txtListeningText.setTextColor(Color.BLACK);
Intent mSpeechRecognizerIntent = new Intent(MLAsrConstants.ACTION_HMS_ASR_SPEECH);
mSpeechRecognizerIntent.putExtra(MLAsrConstants.LANGUAGE, MLAsrConstants.LAN_EN_IN);
mSpeechRecognizerIntent.putExtra(MLAsrConstants.FEATURE, MLAsrConstants.FEATURE_WORDFLUX);
speechRecognizer.startRecognizing(mSpeechRecognizerIntent);
} else {
requestPermissions();
}
}
5. Add runtime permission in AndroidManifest.xml file
Code:
<uses-permission android:name="android.permission.RECORD_AUDIO" />
6. Before startRecognizing need to check runtime permission, Check the below methods for check and request permissions
Code:
private boolean checkPermission() {
if (ActivityCompat.checkSelfPermission(this, Manifest.permission.RECORD_AUDIO) == PackageManager.PERMISSION_GRANTED) {
return true;
} else {
requestPermissions();
return false;
}
}
private void requestPermissions() {
ActivityCompat.requestPermissions(this, new String[]{Manifest.permission.RECORD_AUDIO}, REQUEST_RECORD_AUDIO);
}
Override onRequestPermissionResult method
Code:
@Override
public void onRequestPermissionsResult(int requestCode, @NonNull String[] permissions, @NonNull int[] grantResults) {
super.onRequestPermissionsResult(requestCode, permissions, grantResults);
if (requestCode == REQUEST_RECORD_AUDIO) {
if (grantResults[0] == PackageManager.PERMISSION_GRANTED) {
cardListening.setVisibility(View.VISIBLE);
startCustomASR();
} else {
requestPermissions();
}
}
}
7. Add Count down time like this
Code:
void countDown() {
if (countDownTimer != null) {
countDownTimer.cancel();
}
countDownTimer = new CountDownTimer(7000, 1000) {
@Override
public void onTick(long l) {
}
@Override
public void onFinish() {
rlTryAgain.setVisibility(View.VISIBLE);
imgListening.setVisibility(View.GONE);
txtListeningText.setText("Try Again");
stopSpeechListener();
}
};
countDownTimer.start();
}
8. Release resources after the detection is complete
Code:
private void stopSpeechListener() {
if (speechRecognizer != null) {
speechRecognizer.destroy();
}
}
Find the output in below image
Conclusion
This article covers how to use ASR without Pickup UI, Always do not use default one sometimes need to try custom ASR UI
Reference link
https://developer.huawei.com/consumer/en/doc/development/HMSCore-Guides/ml-asr-0000001050066212

---

Very interesting, thank you.

---

Very useful with a translator if you need to travel in another country.