Building More Audio and Video Service Scenarios with AV Pipeline Kit - Huawei Developers

AV Pipeline Kit is a new product released in HMS Core 6.0 that embodies Huawei's effort to open its technologies in the media field. With a framework that enables you to design your own service scenarios, it equips your app with rich and customizable audio and video processing capabilities. The preset plugins and pipelines for audio and video collection, editing, and playback have simplified the development of audio and video apps, social apps, e-commerce apps, and more.
AV Pipeline Kit provides three major capabilities: pipeline customization, video super-resolution, and sound event detection.
With pipeline customization, you'll be able to build brand new media collection, editing, and playback capabilities and offer excellent user experience. Customized plugins will be automatically parsed by the framework of AV Pipeline Kit, and plugins will be used intelligently according to the hardware capabilities. On top of this, third-party plugins are also available for integration as long as they comply with the requirements of this kit, freeing you from complicated development work and allowing you to prioritize media service innovations.
Video super-resolution offers users an excellent experience even when they watch low-resolution videos. It supports frame-by-frame super-resolution during the playback of a low-resolution video to reduce noise and enhance color in real time, while high-resolution videos will be processed to deliver better images. Currently, resolutions from 270P to 720P and a maximum scale factor of 3 are supported. This capability also enables your app to flexibly adjust the super-resolution effect according to the video resolution and bit rate.
Another capability of AV Pipeline Kit is sound event detection, which detects sound events during audio playback in a fast and accurate manner. Currently, 13 types of sound events can be detected, like knocking on the door, vehicle horns, baby's cry, and sounds made by cats and dogs. With this capability integrated, your app will make users' home safer by detecting potential accidents around the home.
AV Pipeline Kit is easy to use, high performing, and consumes low power.
It provides preset pipelines that support basic media collection, editing, and playback capabilities. You can quickly integrate these pipelines into your app or tailor them to your specific service needs.
In terms of performance, AV Pipeline Kit ensures that data is uniformly encapsulated regardless of its formats, so that data will not be copied between modules. With hardware detection capabilities, the kit has managed to achieve more than 10% performance increase compared with traditional pipelines by preferentially calling nodes that support hardware acceleration.
A major difficulty in media app development has been to ensure better user experience by cutting power consumption. AV Pipeline Kit has managed to save power consumption by more than 20% by preferentially loading hardware capabilities, balancing out performance and power consumption. This is realized by a multi-modal media framework that always avoids unnecessary data copy and data format conversion.
With the open capabilities of AV Pipeline Kit, developing audio and video apps that deliver excellent user experience will be much easier.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}

What are the supported video file format?

useful sharing.

Thanks for sharing..

Related

HUAWEI Camera Kit Provides Capabilities to Improve Camera Performance

A common plotline in wuxia dramas has a character gaining a huge boost in martial abilities after their energy flows become unblocked. Although these stories are fictional, HUAWEI Camera Kit can function as something like an energy flow that helps apps acquire new capabilities.
The camera performance of Huawei phones has received much praise from users, with some describing them as "professional cameras with phone features". For example, thanks to Huawei's proprietary Night mode, Huawei phones can take impressive photos even in low-light environments.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
This is possible not only because of powerful hardware, but also Huawei's software algorithms. Huawei phones also support features such as HDR video and wide aperture for shooting in different scenarios.
The front camera can record video in HDR mode, which captures more detail in backlit or low-light environments.
Wide aperture mode can blur the background to make the subject stand out.
These are some built-in features of the Huawei phone system camera. Many third-party apps also provide photo and video capture. By opening its photography capabilities to developers, Huawei hopes to help give users a better experience in these apps.
As Android hasn't opened all capabilities and APIs to developers, third-party apps can use only its native interface for development. Consequently, the camera performance in third-party apps pales in comparison to the Huawei system camera. With Camera Kit, Huawei hopes to provide developers with easy-to-use APIs that they can utilize to provide a better user experience.
The Camera Kit SDK provides APIs for camera apps, which can be directly called by developers. Camera Kit also supports static compilation, and has a small size of 100k and excellent compatibility.
Photography capabilities at software-level are also integrated into Camera Kit, such as camera modes (e.g. wide aperture, figure, HDR video, and night modes), camera actions and parameters, and operation collections (such as preview, photo capture, recording, and analyzing), covering every step of the photographing process. In addition, Camera Kit supports quick development of extension within two hours, which can reduce the time and cost of app development. It takes just five steps to connect to Camera Kit—mode creation, mode configuration, mode operations, CallBack, and mode release—in order to acquire its multi-faceted camera capabilities.
With the help of Camera Kit, third-party apps on Huawei phones can utilize the features of the system camera, such as Night mode and Super slow-mo mode. Huawei hopes to work with developers in providing a better photography experience to customers.
Credit to ALOMENT from HUAWEI Developer Forum
For more HMS and AppGallery introduction, please visit: HUAWEI DevHub

[HMS Core 6.0 Launch] Video Editor Kit: Building Blocks for Video Editing Capabilities

Video Editor Kit is a one-stop toolkit that offers a rich array of video processing capabilities, including video import/export, editing, rendering, and media resource management. With its powerful, intuitive, and compatible APIs, you can easily create a video editing app for a rich array of scenarios.
One-stop toolkit with comprehensive video editing services
Video Editor Kit provides a product-level SDK that delivers wide-ranging capabilities for video editing. This kit offers great stability and reliability, and can be integrated easily in as short as 2 hours. In short, the product-level SDK saves you time and money, and the kit is available worldwide in 70+ languages, helping you expand app market.
The kit features video import, export, and editing to help users effortlessly create impressive videos. Users can import videos and images in multiple formats, with no limitations on the number of imported content. For video editing, it supports multi-video and multi-audio tracks, and allows users to set different aspect ratios. Users can preview edited videos in real time and customize the video covers. Moreover, users can recreate copyrighted content such as filters and fonts, to bring ideas to life. As for exporting videos, users can choose from multiple resolutions and frame rates, and quickly export their videos. Last but not least, Video Editor Kit delivers a wide range of preset materials, including filters, text, stickers, special effects, and animations, for users to choose from.
Enhanced industry app experience
Video Editor Kit provides one-stop editing services for a wide range of scenarios. For example, the kit delivers services such as image-based video generation, video cropping, merging, and splitting, and special effects to video editing apps. In photoshoot & retouch apps, the kit allows users to beautify objects, and add filters, special effects, and stickers to their photos. In fields like travel, social networking, e-commerce, and news, Video Editor Kit also offers intuitive video editing functions to deliver instant immersion.
Video Editor Kit, a newly-released service in the Media field, utilizes Huawei's advanced technologies, allowing you to easily create video editing tools and helping boost app innovations in diverse industries.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Does this video editing provide videos fx?
ProManojKumar said:
Does this video editing provide videos fx?
Click to expand...
Click to collapse
Hi, Video Editor Kit provides preset materials including video fx. You can access official site to check more details. Thank you.
Video Editor Kit
The one-stop toolkit provides a rich array of video processing capabilities, including video import/export, editing, rendering, and media asset management, for fast and easy development. Its open, reliable APIs allow you to create the perfect possible video to address any scenario.
developer.huawei.com

[HMS Core 6.0 Global Release] New CG Kit Plugins Offer Breathtaking HD 3D Graphics for Breakthrough Mobile Gaming Interactions

HMS Core 6.0 was released to global developers on July 15, providing a wide range of new capabilities and features. Notably, the new version features Volumetric Fog and Smart Fluid plugins within HMS Core Computer Graphics (CG) Kit, two capabilities that lay a solid technical foundation for an enhanced 3D mobile game graphics experience.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
The Volumetric Fog plugin is an inventive mobile volumetric fog solution that renders realistic fogs characterized by complex lighting effects. It harnesses Huawei's prowess in low-level GPU hardware technology, resulting in premium, power-efficient performance. The plugin takes less than 4 ms to render a single frame on high-end Huawei phones, and comes equipped with height fog and noise fog features. Height fogs, like fogs in the real world, get thicker the closer they are to the ground, and likewise become thinner as the altitude increases. The noise fog feature allows developers to adjust the density, extinction coefficient, scattering coefficient, and shape of the fog, as well as wind direction. The plugin also supports volumetric shadows under global directional light and dynamic lighting with moving global ambient light (sunlight) or local lights (point lights and spot lights).
CG Kit also comes with an all-new Smart Fluid plugin that provides three key features: (1) simulated high-speed shaking with realistic physical features retained, a broadly applicable solution; (2) scaling, applicable to objects of various sizes from small backpacks to boxes that consume the entire screen; (3) enriching interactions, including object floating and liquid splash, which can be used to reproduce waterfalls, rain, snow, smoke, and fireworks. CG Kit takes mobile performance limitations and power consumption requirements into consideration, based on the native method, ensuring highly vivid visuals while eliminating unnecessary overhead. The kit also empowers computer shaders to tap into the device compute power potential, to deliver optimal performance per unit time. In addition, the scene-based in-depth analysis optimization algorithm streamlines the computing overhead, resulting in a mobile computing duration of less than 1 ms. The kit employs smoothed-particle hydrodynamics (SPH) on mobile devices for the first time, achieving a leap forward in the fluid rendering on mobile devices, enabling developers to craft true-to-life interactive scenes in real time and strengthening the ties between players and games.
The new plugins of HMS Core CG Kit make it remarkably easy for developers to apply high-resolution game graphics, and pursue trailblazing game play innovation bolstered by lifelike visuals.

[HMS Core 6.0 Global Release]Effortlessly Develop Audio Editing Functions with Audio Editor Kit

Audio Editor Kit consolidates Huawei's cutting-edge technologies for music and speech, as well as the wider audio field. This versatile toolkit is ideal for all kinds of scenarios, thanks to its rich audio-processing capabilities that include audio editing, audio source separation, spatial audio, voice changer, and noise reduction. With its powerful, open, yet easy-to-use APIs, the kit helps integrate audio editing functions into your app effortlessly and efficiently.
​
The sound field, music style, and equalizer capabilities of Audio Editor Kit provides various sound effects that can be applied to audio. On top of this, the kit allows customized sound effects to be added. One of the kit's more quirky features is the voice changer, which allows users to change their voices to a monster, or other funny or scary voices. The audio source separation capability utilizes AI and has been trained with huge data. This capability parses the voice track and accompaniment track in a song and then isolates the latter into a separate track, which is useful for karaoke and music editing app developers. Another capability is spatial audio, which intuitively specifies the locations of different audio tracks in 3D space. And last but not least is the scene effect capability. Using it, users can enjoy audio in different scenes like underwater, broadcast, earpiece, and gramophone. These two capabilities help satisfy audio editing requirements in scenarios such as editing surround sound and adding BGM.
Boasting such diverse capabilities, Audio Editor Kit enables audio/video editors to handle multi-track audio in a manageable way and helps live-streamers efficiently optimize the sound of their voices. In the future, Audio Editor Kit will provide even more capabilities, such as AI dubbing. It can convert text into emotionally expressive narration with a lifelike timbre that is created with the help of deep learning. Meanwhile, audio source separation will allow users to isolate a specific instrument sound (like piano, guitar, and violin) into a separate audio track. In short, Audio Editor Kit will remain fully dedicated to meeting the diverse needs of the audio field, helping develop useful audio editing apps.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Can we change the audio of a particular video file?
very useful sharing, thanks!!

AI Color from HMS Core Video Editor Kit Rejuvenates Old Photos

Since 1839 when Louis Daguerre invented the daguerreotype (the first publicly available photographic process), new inventions have continued to advance photography. Its spike reached a record high where people were able to record experiences through photos, anytime and anywhere. However, it is a shame that many early photos existed in only black and white.
HMS Core Video Editor Kit provides the AI color function that can liven up such photos, intelligently adding color to black-and-white images or videos to endow them with a more contemporary feel.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
In addition to AI color, the kit also provides other AI-empowered capabilities, such as allowing your users to copy a desired filter, track motions, change hair color, animate a picture, and mask faces.
In terms of input and output support, Video Editor Kit allows multiple images and videos to be imported, which can be flexibly arranged and trimmed, and allows videos of up to 4K and with a frame rate up to 60 fps to be exported.
Useful in Various Scenarios
Video Editor Kit is ideal for numerous application scenarios, to name a few:
Video editing: The kit helps accelerate video creation by providing functions such as video clipping/stitching and allowing special effects/music to be added.
Travel: The kit enables users to make vlogs on the go to share their memories with others.
Social media: Functions like video clipping/stitching, special effects, and filters are especially useful for social media app users, and are a great way for them to spice up videos.
E-commerce: Product videos with subtitles, special effects, and background music allow products to be displayed in a more intuitive and immersive way.
Flexible Integration Methods
Video Editor Kit can now be integrated via its:
UI SDK, which comes with a product-level UI for straightforward integration.
Fundamental capability SDK, which offers hundreds of APIs for fundamental capabilities, including the AI-empowered ones. The APIs can be integrated as needed.
Both of the SDKs serve as a one-stop toolkit for editing videos, providing functions including file import, editing, rendering, output, and material management. Integrating either of the SDKs allows you to access the kit's powerful capabilities.
These capabilities enable your users to restore early photos and record life experiences. Check out the official documentation for this great Video Editor Kit, to know more about how it can help you create a mobile life recorder.

Categories

Resources