HMS ML Kit- Real-Time Audio Transcription
For many app developers, a reliable real-time audio transcription system is essential for certain types of apps. Developers who create their app with HMS will be able to take advantage of ML Kit and its great audio transcription capabilities. This feature will allow users to transcribe long-form speech into written text. The length of the recording time caps at 4 hours long. This makes it a good solution for recording lectures or meetings. The generated text will include punctuation and timestamps, making it perfect for note-taking. Currently, Mandarin Chinese, English, and French can be recognized, including Chinese-English bilingual speech.
Developers looking to implement ML Kit's real-time audio transcription should know that this feature is currently only compatible with Huawei devices. Since the feature depends on a cloud API for speech recognition, the user's device will have to be connected to the internet for it to function properly.
Using the ML Kit demo APK, you can see this technology in action.
How Developers are Implementing Real-Time Audio Transcription
There are many different ways that audio transcription can be implemented into an app. One of the ways we see developers putting this to use is in the form of live subtitles. Live subtitles are great accessibility features, with the ability to transcribe audio into readable text, from videos you watch on your phone.
Another example of how this feature can benefit users is in the form of apps that allow you to record and transcribe conferences, meetings, and lectures. This is the best way to document spoken words, and reference them later.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Developer Resources
Huawei provides plenty of documentation and guides to help you get started with ML Kit's Real-Time Transcription. You can get started with this guide here.
For all of the functions of ML Kit, refer to their service portal here.
For an overview of their APIs, browse the comprehensive resource library here.
You can also look at different ways that ML Kit can be implemented, by seeing a collection of sample codes here.
Can I convert the local language to another language?
Does it supports multi language transcription??
Related
HMS Core │ How WisePlay DRM Gives Your Audio & Video Works the Exposure They Deserve
Huawei WisePlay DRM is a Digital Rights Management solution
Enabling you to keep all your works under lock-and-key
Digital Rights Management (DRM) is a technology used to protect digital assets, including audio and video content, installation packages, and e-books. DRM uses two methods to safeguard audio and video content: rights management (such as controls on playback times or duration) and stream encryption, providing for highly-secure and reliable transmission.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
WisePlay DRM is Huawei's cutting-edge DRM solution that is based on the ChinaDRM standard and has been certified by numerous authorities. Better yet, WisePlay DRM is entirely royalty-free.
Uncompromising Performance, and Versatile Coverage on Huawei Devices
Huawei is dedicated to providing secure, reliable, and innovative products and services. WisePlay DRM only furthers this legacy, with remarkably-effective content protections, such as corresponding keys for files and watermarks. WisePlay DRM supports both software- and hardware-level encryption. Bolstered safeguards offer premium mediums, such as ultra-HD video and VR content, the protection they require in today's rapidly-evolving digital landscape. WisePlay DRM can run on a diverse range of Huawei devices, including smartphones, tablets, and smart screens, while providing users with a consistent experience across the board.
Effortless Integration
The WisePlay DRM server is cloud-based and can be easily integrated via APIs, without the need to deploy any additional servers. WisePlay DRM supports ISO Common Encryption and could complement the incumbent MultiDRM solution without re-encrypted content.
Free to Use
WisePlay DRM is a native security solution for Huawei devices. No fees are incurred for license authorization when it is applied to Huawei devices. WisePlay DRM protects your content while lowering operating expenses and providing unique opportunities to expand your business. It also comes with abundant documents, SDK, sample code, for accelerated, low-cost development.
Diverse Functions that Raise the Bar for WisePlay DRM
WisePlay DRM offers a treasure trove of first-rate features, including online and offline playback, video on demand (VOD), and live streaming. It supports multiple stream types (HLS, DASH, etc.) and diverse file formats (MP4, TS, etc.), and in doing so, easily copes with your content protection requirements.
Streamlined Integration Process
WisePlay DRM has been widely deployed in the Chinese market, and applied across Internet streaming media apps, such as HUAWEI Video, which reach more than 10 million devices. It provides digital rights management for content worldwide. Due to the large-scale deployment of Huawei Mobile Services (HMS) outside of China, WisePlay DRM has come to be recognized around the world as the DRM solution of choice for content creators. It provides end-to-end services that are easy to integrate, facilitating global distribution for your content, accompanied with reinforced safeguards for intellectual property rights.
WiseDRM Kit provides easy-to-use programming APIs, which you can call to develop the desired digital rights management functions, regardless of the underlying network technology. For guidance during the WiseDRM Kit integration process, please go to the HUAWEI Developer website, where you will find the integration guide and other resources for reference, or you can contact us by work order for further technical assistance.
More information about this, you can visit HUAWEI Developer Forum.
Smartphones have become the single most important smart device in the digital age, thanks to a full-fledged mobile device and communications ecosystem. However, most people will opt to switch to a larger screen device for full-scale immersion, when watching a movie or gaming. Marrying smartphone functionality with the benefits of a large-screen device, allows for the content on a smartphone to be projected on to an expansive display, offering a new paradigm for entertainment, as well as remote work and learning.
As a core distributed technology in Huawei's EMUI system, HUAWEI Cast+ Kit incorporates the strengths of both large and smaller screen devices, and seamlessly bridges the divide between the two systems, facilitating effortless cross-device transfers of media content.
Ultra low latency
Revolutionizing the game projection experience
Projecting games with HUAWEI Cast+ Kit ensures that the projected content on the TV is in sync with the action on your phone, with projection latency as low as 50 ms. This provides for a whole new realm of fully-immersive gaming.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Proprietary streamlined communications mechanism
Resolving the trade-off between smoothness and clarity
During projection, the Wi-Fi environment is prone to interference and instability due to the potentially high number of devices connected to the same network. Due to this and the resulting packet loss, frame freezing and artifacts will tend to occur. The common resolution for most brands is to sacrifice smoothness for clarity, or vice versa. But now it's possible to enjoy the best of both worlds: high quality imagery with a smooth display.
HUAWEI Cast+ Kit is the culmination of three years of optimization and iteration, and is based on Huawei's own streaming media communication and transmission protocols. It redesigns the algorithm at the streaming media transmission layer to ensure strong anti-interference capabilities. Even when the packet loss rate reaches 25%, HUAWEI Cast+ Kit still manages to minimize frame freezing and ensure stable data transmission. This ensures a high degree of smoothness and high definition streaming, throughout the entire projection process. Because the optimization is performed at the software layer only, no additional cost is passed on at the hardware layer to device partners.
High-definition mirroring
Reproducing the magnificent graphical performance on your phone
The 1080p HD mirroring provided by HUAWEI Cast+ Kit allows for lossless reproduction of pictures and videos on your phone.
Streamlined connection
Easy, instantaneous projections, on command
HUAWEI Cast+ Kit can be accessed on a Huawei phone, without the need to download and install an additional app. By swiping down the notification panel and touching the Wireless Projection shortcut switch, your phone will automatically search for nearby devices that can be projected to. To project the phone screen, just select the target device. The process is so simple that even technologically-challenged users can perform it with ease. HUAWEI Cast+ Kit comes equipped with a fast discovery mechanism that is based on Huawei-developed algorithms. The minimal time required to establish an end-to-end connection is a staggering 500 ms. HUAWEI Cast+ Kit is a highly-accessible wireless projection solution that is not weighed down by unnecessary bells and whistles, for direct touch-to-connect and casting.
PIN authentication
Secure and convenient
When using the Huawei Cast+ function on a TV for the first time, the user will need to enter the PIN to authenticate the connection. All subsequent connections will not require PIN input. This solution provides for optimal user privacy and security, without compromising convenience in the slightest.
HUAWEI Cast+ Kit is only supported on devices that run EMUI 10.1 or later. EMUI 10.1 debuted on the HUAWEI P40 series of smartphones, which were released on April 8, 2020 in China, and will be made available on a gradual basis, on other phone models. HUAWEI Cast+ Kit is poised to reinvent the nature of cross-device interaction, with Huawei's broad user base, and collaborative capabilities of third-party partners.
For more details about Cast+ Kit development, including a service overview, development guide, access preparation, and access to the SDK, please click the link below:
https://developer.huawei.com/consumer/en/cast-kit/
Really amazing~ Expect more functions about this kit.
March 15 - HMS Core 5.2.0 is now official!
This issue introduces Huawei Network Kit, which gives your networks higher bandwidth and lower latency. New features are available in other kits as well – channel analysis reports in Analytics Kit, and custom special effects of volumetric clouds in Computer Graphics Kit.
Get the details on this update:
https://developer.huawei.com/consum...es/hmssdk-kit-0000001050042513?ha_source=hms3
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
New Kits
Network Kit：
The on-device SDK of Network Kit provides:
(1) A network request framework based on RESTful APIs, helping accelerate the access speed and reduce network latency, while also supporting smooth network migration in weak network environments.
(2) A file upload and download function, based on multi-task and multi-thread technologies. It fully utilizes network bandwidth resources and supports resumable data transfer, resulting in a notably enhanced user experience during file uploading and downloading.
(3) A range of network acceleration services, including hQUIC Kit and Wireless Kit. Integrating Network Kit brings about an all-link acceleration experience. The Kit supports HMS Core ecosystem partners in industries like game and e-commerce in developing mobile apps with lower latency and higher throughput
Learn More
New features
Analytics Kit:
Added the channel analysis report, which offers a number of analytical dimensions, including new users, active users, total users, and day-2 retention. These indicators help you comprehensively evaluate the quantity and quality of new users acquired from each app store, boosting your ROI.
Upgraded install attribution. This function is now capable of intelligently distinguishing between paid traffic and organic traffic, as well as tracking app installation sources, helping acquire new users more accurately.
Provided a rich range of user profile tags, including App uninstalled, Consecutive active days, and Consumption times tier in last 6 months, which enable you to perform targeted operations and precision marketing.
Added the SDK for quick apps, satisfying the requirements for unified analysis of user behavior.
Learn More
ML Kit:
Added Bulgarian and Croatian to the list of languages supported by real-time translation.
Added Persian, Latvian, and Khmer to the list of languages supported by on-device language detection.
Added support for the function which obtains the list of supported languages for automatic speech recognition, audio file transcription, and real-time transcription.
Added support for the recognition of hair for image segmentation.
Learn More
Video Kit:
Added the pre-loading function. It enables quick starting of videos, improving user experience.
Added the live streaming function. It enables live videos to play with low latency, which can be widely used in live streaming industries such as online education.
Added support for switching between multiple embedded audio tracks and subtitle tracks.
Learn More
Audio Kit :
Enriched audio experience for users by:
Supporting audio playback in chunks. For example, audio files stored on cloud can be played.
Supporting playing audio files in the APK, which is useful in playing audio like special sound effects and background music.
Learn More
CG Kit :
Added the special effects of volumetric clouds. It allows you to customize volumetric clouds and achieve immersive rendering effects on the Android platform, giving gamers the impression that they are hovering amidst actual clouds.
Learn More
Audio Kit :
Enriched audio experience for users by:
Supporting audio playback in chunks. For example, audio files stored on cloud can be played.
Supporting playing audio files in the APK, which is useful in playing audio like special sound effects and background music.
Learn More
Made necessary updates to other kits. Learn More
New Resources
Network Kit :
Sample Code: Added hms-network-demo. The demo illustrates how to integrate Network Kit, make synchronous and asynchronous network request by using HttpClient and RestClient, and use the Kit to upload and download files.
Learn More
Health Kit :
Sample Code: Updated hms-health-demo-kotlin and hms-health-demo-java. Added the readLatestData API to the DataController class to read the latest data point of a specified data type list.
Learn More
For more details, you can go to:
l Our official website
l Our Development Documentation page, to find the documents you need
l Reddit to join our developer discussion
l GitHub to download demos and sample codes
l Stack Overflow to solve any integration problems
when will be launched new version of Map Kit?
March 15 - HMS Core 5.2.0 is now official! This issue introduces Huawei Network Kit, which gives your networks higher bandwidth and lower latency. New features are available in other kits as well – channel analysis reports in Analytics Kit, and custom special effects of volumetric clouds in Computer Graphics Kit.
Get the details on this update:
https://developer.huawei.com/consum...es/hmssdk-kit-0000001050042513?ha_source=hms3
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
New Kits
Network Kit：
The on-device SDK of Network Kit provides:
(1) A network request framework based on RESTful APIs, helping accelerate the access speed and reduce network latency, while also supporting smooth network migration in weak network environments.
(2) A file upload and download function, based on multi-task and multi-thread technologies. It fully utilizes network bandwidth resources and supports resumable data transfer, resulting in a notably enhanced user experience during file uploading and downloading.
(3) A range of network acceleration services, including hQUIC Kit and Wireless Kit. Integrating Network Kit brings about an all-link acceleration experience. The Kit supports HMS Core ecosystem partners in industries like game and e-commerce in developing mobile apps with lower latency and higher throughput.
Learn More
New features
Analytics Kit:
Added the channel analysis report, which offers a number of analytical dimensions, including new users, active users, total users, and day-2 retention. These indicators help you comprehensively evaluate the quantity and quality of new users acquired from each app store, boosting your ROI.
Upgraded install attribution. This function is now capable of intelligently distinguishing between paid traffic and organic traffic, as well as tracking app installation sources, helping acquire new users more accurately.
Provided a rich range of user profile tags, including App uninstalled, Consecutive active days, and Consumption times tier in last 6 months, which enable you to perform targeted operations and precision marketing.
Added the SDK for quick apps, satisfying the requirements for unified analysis of user behavior.
Learn More
ML Kit:
Added Bulgarian and Croatian to the list of languages supported by real-time translation.
Added Persian, Latvian, and Khmer to the list of languages supported by on-device language detection.
Added support for the function which obtains the list of supported languages for automatic speech recognition, audio file transcription, and real-time transcription.
Added support for the recognition of hair for image segmentation.
Learn More
Video Kit:
Added the pre-loading function. It enables quick starting of videos, improving user experience.
Added the live streaming function. It enables live videos to play with low latency, which can be widely used in live streaming industries such as online education.
Added support for switching between multiple embedded audio tracks and subtitle tracks.
Learn More
Audio Kit :
Enriched audio experience for users by:
Supporting audio playback in chunks. For example, audio files stored on cloud can be played.
Supporting playing audio files in the APK, which is useful in playing audio like special sound effects and background music.
Learn More
CG Kit :
Added the special effects of volumetric clouds. It allows you to customize volumetric clouds and achieve immersive rendering effects on the Android platform, giving gamers the impression that they are hovering amidst actual clouds.
Learn More
Audio Kit :
Enriched audio experience for users by:
Supporting audio playback in chunks. For example, audio files stored on cloud can be played.
Supporting playing audio files in the APK, which is useful in playing audio like special sound effects and background music.
Learn More
Made necessary updates to other kits. Learn More
New Resources
Network Kit :
Sample Code: Added hms-network-demo. The demo illustrates how to integrate Network Kit, make synchronous and asynchronous network request by using HttpClient and RestClient, and use the Kit to upload and download files.
Learn More
Health Kit :
Sample Code: Updated hms-health-demo-kotlin and hms-health-demo-java. Added the readLatestData API to the DataController class to read the latest data point of a specified data type list
Learn More
For more details, you can go to:
l Our official website
l Our Development Documentation page, to find the documents you need
l Reddit to join our developer discussion
l GitHub to download demos and sample codes
l Stack Overflow to solve any integration problems
Original Source
Huawei launched HMS Core 6.0 today to global app developers, bringing multiple new open capabilities and updating some existing services and features. As of now, HMS Core (APK) on all user devices has been updated to the 6.0 version. You can access HUAWEI Developers anytime to get the new services and features.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
HMS Core 6.0 further opens up Huawei's advanced technologies in media, graphics, telecommunications, and other fields. For media apps, Huawei provides AV Pipeline Kit with preset pipelines for video super-resolution, sound event detection, and other media services to address audio/video app developers' pain points such as difficulties with capability building and high power consumption. In the graphics field, 3D Modeling Kit offers AI-based capabilities such as 3D object reconstruction and material generation for e-commerce and animation apps, making it possible to generate 3D models even with mobile phones as long as there is an RGB camera installed, bringing more fun to user interactions. This service is currently available to all Android device models.
In addition, Computer Graphics Kit debuts the "volumetric fog" feature powered by the volume rendering technique for dynamic lighting and shadowing fog effects on mobile devices, making indoor scenes more realistic for next-generation mobile games, especially for Cyberpunk-style mobile games. This feature is available to all Android devices supporting Vulkan.
In the telecommunications field where Huawei has gained a leading position, Network Kit has updated its AI-powered network environment prediction function so that network parameters can be optimized based on service network access rules and differentiated network requirements, thereby reducing apps' network latency by more than 20%.
HMS Core 6.0 also provides other services such as Membership Kit, Video Editor Kit, and Audio Editor Kit. You can visit the HUAWEI Developers website to find out more.
As a collection of Huawei's software and hardware open capabilities, HMS Core has always been developer-centric and is continuously opening up Huawei's core technologies and capabilities to more developers, providing a high-quality consistent experience for cross-platform and cross-device apps. HMS Core empowers you to develop Web apps, Quick Apps, and apps in Android and HarmonyOS running on phones, tablets, smart displays, wearables, and head units, using cross-platform development frameworks such as React Native and Cordova.
Original Link:https://consumer.huawei.com/en/press/news/2021/huawei-hms-core-6-set-for-global-release/
great news thanks for sharing