Your Face Gives You Most Reliable Security - Huawei Developers

For more information about Huawei open capability and services, you can visit HUAWEI Developer Forum and Medium.​
In this fast-paced, information-charged era, portable electronic devices such as mobile phones have become indispensable to our daily lives. They allow us to interact with the world and enjoy ourselves, during work, in our personal lives, or when we seek entertainment. An electronic device is like a world in itself, providing us not only with slick apps but also a sense of security—we are so used to having phones around us that we feel uncomfortable and insecure without them.
In order to enhance this sense of security, the vast amount of private information stored on phones must be strongly protected. At present, facial recognition is undoubtedly one most secure, effective, practical, and convenient security protections, when compared to password, fingerprints, or other forms of security. Its working principle is to analyze facial features and complete a facial comparison quickly, on the basis of having already obtained facial feature images. Facial recognition is widely used in scenarios such as logins and payments to protect user privacy.In this fast-paced, information-charged era, portable electronic devices such as mobile phones have become indispensable to our daily lives. They allow us to interact with the world and enjoy ourselves, during work, in our personal lives, or when we seek entertainment. An electronic device is like a world in itself, providing us not only with slick apps but also a sense of security—we are so used to having phones around us that we feel uncomfortable and insecure without them.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Huawei deeply respects individual privacy and strives to continuously develop security technologies to overcome limitations and provide continuous optimizations and upgrades. Huawei's facial recognition technology uses 3D structured light technology involving 3D depth-sensing facial technology (which consists of multiple sub-modules including a structured light module, secure running environment, facial recognition algorithm, and upper-layer applications) to capture 3D facial data, resulting in more accurate capture of facial information and faster facial recognition. This achieves improvements in both accuracy and security.
Security: all day, all night
Huawei's 3D facial recognition technology is based on the principle of 3D structured light. The structured light module includes a speckle projector, an infrared illuminator, and an infrared camera. When recording facial data, the speckle projector projects 30,000 invisible specks of light onto facial features to obtain face depth information. At the same time, the infrared illuminator is turned on to help obtain facial feature information. With this information, and the image taken by the infrared camera, accurate facial data can be obtained.
Compared to coded structured light, the lights projected by the speckle projector are random and therefore more secure. In addition, the infrared camera can accurately identify facial features such as the nose tip, pupil reflections, or cheekbone shadows by recognizing key facial points, and through 3D anti-counterfeiting. Thanks to the infrared camera and the speckle projector, facial features can be recognized even in backlit or low-light environments, allowing users to unlock their phones with their faces both in the day and at night.
Such highly accurate facial recognition allows for unlocking within milliseconds, providing a fast and smooth experience.
Security: 360-degree personalization
3D facial features are hard to copy. As a cutting edge technology, 3D facial recognition is an improvement on fingerprint recognition and 2D facial recognition technologies and has an error rate of only one millionth.
Huawei 3D facial recognition technology uses 3D structured light to create 3D anti-counterfeiting labels, greatly improving accuracy and security.
Hardware-based encryption and anti-theft feature: Recorded facial data is processed to remove some information while retaining key features. Therefore, even if the phone is stolen, facial data cannot be restored, preventing the facial data from being stolen.
Preventing unlocking the phone with photos: The reflectivity of infrared light varies on different objects. Therefore, Huawei 3D facial recognition technology is able to accurately identify and reject printed photos, electronic photos, videos, silicone masks, or 3D models, preventing other people from using the user's photos or videos to unlock the phone.
Preventing unlocking the phone when user's eyes are closed: Huawei 3D facial recognition technology can detect whether the user's eyes are closed. The phone is unlocked only when the user looks at the screen with both eyes open. This effectively prevents other people from unlocking the user's phone when the user is asleep.
Highly accurate and secure, Huawei 3D facial recognition technology can be used in various scenarios, such confirming payments, unlocking apps and files, or unlocking phone hence comprehensively protecting users' rights and interests. Huawei 3D facial recognition technology identifies users' unique appearance, providing users with a fully personalized, secure, comfortable, and high-quality experience.

Related

Getting to Know the P40 with HUAWEI OneHop Kit

As we all know, Huawei unveiled the HUAWEI P40 series at 19:30 on April 8th. The all-new line of flagship smartphones are highlighted by the presence of five Leica cameras, a Quad-curve Overflow Display with 90Hz refresh rate, and a staggering 100X Digital Zoom feature. But wait, there's another highlight that we'd be remiss not to metion… HUAWEI OneHop!
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Tap to Explore
HUAWEI OneHop Kit serves as an all-scenario solution that facilitates seamless interaction between different devices. By leveraging NFC technology, it streamlines the collaboration between the smartphone and your other devices, including certain third-party devices, and can be initiated with a simple tap. Thus far, HUAWEI OneHop Kit has been integrated for laptops, smart TVs, and tablets, and incorporates a diverse range of app capabilities, including OneHop transfer, OneHop projection, and OneHop continuity.
Tapping the NFC area on the phone against the NFC tag on the laptop establishes an instant connection between the two devices. Tapping again initiates two way file transfers, enhancing efficiency by making file transmission nearly instantaneous
If you would like to project your phone screen to a smart TV, just enable NFC on your phone, and tap it against the NFC tag on the remote control for the TV. Just like that, the content on your phone will appear on the larger screen device. This revolutionizes the way your phone interacts with your surroundings, and provides for immersive leisure at all times.
Better yet, you are freed from the hassle of manual connections, or the all-too-common disappointment of learning that the video on your phone can't be viewed on a larger screen. Simply by tapping the NFC area on your phone against that on your phone, you can rest assured knowing that the video will be synced to the tablet in the exact same state that it was playing on your phone. With the recent release of version 8.6.3 of the YouTube app on AppGallery, you can now enjoy all of your favorite content, in all of its splendor.
Versatile Mobile Office Functions
Huawei's distributed technology is underpinned by a high degree of hardware-software synergy, which allows for effortless collaboration between different devices. This provides for interactions that are as easy and intuitive as saying conversing with a friend. The implications for work efficiency are enormous. Half-completed files can be synced to other devices, with zero effort, and half-watched videos can be picked up right where they left off, on another device.
Enhanced Efficiency Across the Board
Huawei's "1+8+N" framework, proposed in 2019, with "N" standing for third-party devices, envisions an all-encompassing, all-embracing smart device ecosystem, in which other electronics brands are invited into the fold. In this spirit, Huawei will introduce the Kit to a wider range of devices in the near future, including car kits, IoT devices, speakers, and wearables, so that its benefits touch upon every facet of daily life.
HUAWEI OneHop Kit breaks down arbitrary barriers between different devices, making genuine cross-device collaboration a living, breathing reality.
For the developer guide, please visit HUAWEI Developer at: https://developer.huawei.com/consumer/en/doc/development/connectivity-Guides/OneHop--guide
Any questions about this kit, you can try to acquire answers from HUAWEI Developer Forum.
Great tech from Huawei,
desaturated said:
Great tech from Huawei,
Click to expand...
Click to collapse
Yeah. Expect its better performance.
Freemind R said:
As we all know, Huawei unveiled the HUAWEI P40 series at 19:30 on April 8th. The all-new line of flagship smartphones are highlighted by the presence of five Leica cameras, a Quad-curve Overflow Display with 90Hz refresh rate, and a staggering 100X Digital Zoom feature. But wait, there's another highlight that we'd be remiss not to metion… HUAWEI OneHop!
Tap to Explore
HUAWEI OneHop Kit serves as an all-scenario solution that facilitates seamless interaction between different devices. By leveraging NFC technology, it streamlines the collaboration between the smartphone and your other devices, including certain third-party devices, and can be initiated with a simple tap. Thus far, HUAWEI OneHop Kit has been integrated for laptops, smart TVs, and tablets, and incorporates a diverse range of app capabilities, including OneHop transfer, OneHop projection, and OneHop continuity.
Tapping the NFC area on the phone against the NFC tag on the laptop establishes an instant connection between the two devices. Tapping again initiates two way file transfers, enhancing efficiency by making file transmission nearly instantaneous
If you would like to project your phone screen to a smart TV, just enable NFC on your phone, and tap it against the NFC tag on the remote control for the TV. Just like that, the content on your phone will appear on the larger screen device. This revolutionizes the way your phone interacts with your surroundings, and provides for immersive leisure at all times.
Better yet, you are freed from the hassle of manual connections, or the all-too-common disappointment of learning that the video on your phone can't be viewed on a larger screen. Simply by tapping the NFC area on your phone against that on your phone, you can rest assured knowing that the video will be synced to the tablet in the exact same state that it was playing on your phone. With the recent release of version 8.6.3 of the YouTube app on AppGallery, you can now enjoy all of your favorite content, in all of its splendor.
Versatile Mobile Office Functions
Huawei's distributed technology is underpinned by a high degree of hardware-software synergy, which allows for effortless collaboration between different devices. This provides for interactions that are as easy and intuitive as saying conversing with a friend. The implications for work efficiency are enormous. Half-completed files can be synced to other devices, with zero effort, and half-watched videos can be picked up right where they left off, on another device.
Enhanced Efficiency Across the Board
Huawei's "1+8+N" framework, proposed in 2019, with "N" standing for third-party devices, envisions an all-encompassing, all-embracing smart device ecosystem, in which other electronics brands are invited into the fold. In this spirit, Huawei will introduce the Kit to a wider range of devices in the near future, including car kits, IoT devices, speakers, and wearables, so that its benefits touch upon every facet of daily life.
HUAWEI OneHop Kit breaks down arbitrary barriers between different devices, making genuine cross-device collaboration a living, breathing reality.
For the developer guide, please visit HUAWEI Developer at: https://developer.huawei.com/consumer/en/doc/development/connectivity-Guides/OneHop--guide
Any questions about this kit, you can try to acquire answers from HUAWEI Developer Forum.
Click to expand...
Click to collapse
I just bought HUAWEI P40 Pro last week. Maybe it is time to try this for fun.
---------- Post added at 07:13 AM ---------- Previous post was at 07:10 AM ----------
About the phone P40 Pro, it's good for me for example multiple functions, amazing camera, and its curved screen. Satisfy with those.

Distributed AI: Smart, Seamless Living with No Bounds

This article is from HUAWEI Developer Forum
Forum link: https://forums.developer.huawei.com/forumPortal/en/home
​
AI has reshaped the world around us, and how we interact with our surroundings.
When you take a photo with your phone, the AI camera can identify what's in the frame (for example, the blue sky or spread of food), and apply intelligent enhancements that correspond to the scene, generating detailed and vibrant images. You can remain productive, even when your hands are occupied, thanks to voice assistants like HiVoice or Siri on your phone. Make payments with AI-powered face recognition, in which your phone stores and analyzes your facial profile, even recognizing your behavioral patterns, to determine when it is you making a purchase, or logging in to an account.
In 2017, the release of Huawei's Kirin 970 captured the industry's imagination. As the first-ever mobile chipset to integrate an independent neural processing unit (NPU), the Kirin 970 represented a milestone for mobile AI. The following year, Huawei unveiled its HiAI platform, opening up Huawei's chipset, device, and cloud capabilities to global developers, and providing invaluable assistance by bolstering a wide range of apps with newfound intelligence.
Since its advent, HUAWEI HiAI has focused on applying innovative new technology from the bottom layer of the system on up. Distributed intelligence forms the key to transforming device software and hardware from isolated capabilities into a collaborative, mutually-reinforcing ecosystem. In this way, HUAWEI HiAI enables software and hardware makers to facilitate innovation in their respective areas of expertise, and contribute to the seamless user experience of tomorrow.
AI cares…
Technology seems like magic, in a sense. It helps unlock unforeseen potential, enriching the lives of countless individuals, in particular, those with disabilities. New apps are constantly being introduced, offering life-altering capabilities.
Huawei has teamed up with IIS Aragon and DIVE Medical to jointly launch the TrackAI project, which is dedicated to helping ophthalmologists run visual tests for children, using Huawei smart devices equipped with HiAI. Numerous medical institutes around the world, in China, Spain, Vietnam, Mexico, and Russia, among other countries, have begun amassing the plethora of data required to train the AI algorithm, through their work with over 2,000 visually-impaired children.
TrackAI's complete detection system consists of the Device for an Integral Visual Examination (DIVE), a Huawei P30 mobile phone, and a Huawei MateBook E tablet. The system displays visual stimuli on a screen, and uses an eye track to detect the child's focus. The system can also learn the differences between children with and without an eye disease. Lastly, the Huawei P30 smartphone runs a pre-trained machine learning model, powered by HiAI, to detect whether the child has a visual impairment.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
The HiAI-powered Track AI system can help stop an eye disease in its tracks​
Compared with traditional models, in which data is uploaded to the cloud for analysis, with the results transferred back to devices, HUAWEI HiAI's on-device analysis is remarkably efficient. In leveraging the local Kirin chipset for AI processing, users have access to real-time analysis, with less latency. Even in rural areas where Internet access is spotty, doctors can still use the TrackAI system for testing. This provides for tremendous benefits for children's healthcare in developing countries.
On-device processing also provides for enhanced privacy safeguards. Users can rest assured that data is stored only on their device, avoiding the risks associated with cloud storage, such as data leak.
Huawei has drawn on AI to improve the lives of those living with disabilities, in a myriad of other ways.
In collaboration with the Polish Blind Association, Huawei developed Facing Emotions, an app designed to assist the blind and visually-impaired perceive emotions through the power of sound. The app uses the rear camera and AI on Huawei phones to translate human emotions into unique sounds. For the millions of people who are unable to see faces and read emotional cues, this offers a truly life-altering capability, bringing them closer to friends and loved ones. Imagine the joy of "hearing" a smile for the first time!
There's also StorySign, an app that helps deaf children read by translating the text from selected books into sign language. Huawei partnered with the European Union of the Deaf, Penguin Books and Aardman Animations, as well as other organizations, in developing StorySign. When a child opens a selected reading book in front of them, then opens the app and holds the phone over the page, an avatar signs the story, while the app highlights each word that has been signed. Thanks to multi-lingual Optical Character Recognition (OCR) and document adjustment technology, StorySign now supports more than 10 European sign languages. StorySign enriches of lives of deaf children and their parents, opening up a wondrous world of storytelling and literature, in which they learn to read and sign together.
HUAWEI HiAI powered StorySign supports more than 10 European sign languages​
Huawei has also provided crucial assistance to the Chinese-developed Qimingtong app, which is designed to help the visually-impaired better interact with the world around them. The app reads text out loud, such as that from newspaper articles, letters, and product user guides. It also leverages HUAWEI HiAI capabilities, including face detection and facial feature detection, and enables the visually-impaired to take pictures following simple voice instructions.
All of the above apps are powered by AI, and it is HUAWEI HiAI's primary mission is to make app development effortless.
HUAWEI HiAI provides developers with access to the truly boundless potential from Huawei's chipset, device, and cloud technology. On the chipset side, developers benefit from cutting-edge NPU acceleration. Device capabilities bolster face, image, text, and speech recognition, while cloud technology enables apps to provide timely scenario-based services.
AI empowers...
Developers are dreamers, and HUAWEI HiAI is the platform that helps them fulfill their dreams. Since its debut in 2018, HUAWEI HiAI has connected more than one million developers, and 4000 partners.
SketchAR, a tool for teaching drawing using augmented reality (AR) and AI, offers a prime exactly of how HiAI has revolutionized user experience. It enables users to transmit an image from their device onto any surface, such as a sheet of paper or white wall. The image can then be used on their device as a template for manually drawing on the surface of choice. SketchAR utilizes HUAWEI HiAI's NPU acceleration, to boost image recognition speeds by up by 40%, for improved accuracy and greater responsiveness.
The Chinese-developed app Lvmuxia (Green Screen Compositor) helps users composite a captured video with a background video. Typically, green screen compositing requires powerful computing capabilities, and could previously only be accomplished on the cloud. But as on-cloud computing poses a number of challenges for developers, including high costs, high latency, and privacy risks, it was not practical. By working with HUAWEI HiAI, the Lvmuxia app has overcome those challenges, providing on-device AI capabilities, and shortening the app's time to market.
While attending a conference or lecture, you may want to take photos of the PowerPoint slides for future reference, but the quality of the images can be poor, particularly if you were seated in a corner, or there is some sort of visual obstruction. HiAI provides an elegant solution, with its document adjustment feature, in which photos are straightened, clarifying text and removing unwanted corners. With the OCR feature, you can even add notes or correct mistakes in the text.
From single-device AI to distributed AI
In November 2019, Huawei introduced HiAI 3.0, an open AI capability platform that allows smart devices to share AI computing power between them, representing the tremendous leap from single-device AI to distributed AI.
In its infancy, HUAWEI HiAI 1.0 only supported single type devices. 2.0 expanded to support such devices as phones, tablets, and smart screens. HUAWEI HiAI 3.0 goes even further, pooling hardware resources to form a super device. Powered by distributed AI, devices mutually reinforce each other, providing users with the best possible experience, given the resources at its disposal.
Smart devices are designed to fulfill specific needs, but each category of device comes with drawbacks. For example, smart TVs, watches, and earphones excel in collecting images, videos, and sensor data, but fall short in terms of sheer AI computing power. Smartphones are equipped with increasingly powerful photography features, but still don't compare to dedicated televisions and surveillance cameras, in many regards. Their sound collection capabilities also pale in comparison to a speaker's microphone array.
Huawei developed HiAI 3.0 in response to the ever-present need for enhanced capabilities on smart devices. It works by pooling the hardware resources from different devices to form a super intelligent system. When enriched with shared AI capabilities, all of the participating devices are equipped to provide seamless, cross-device intelligence that is responsive to any and every user whim.
By drawing from such basic distributed technologies as distributed virtual bus and device virtualization, HUAWEI HiAI 3.0 facilitates high-speed connectivity between devices, allowing them to share capabilities and reinforce each other. This has seemingly countless applications in real life.
For example, fitness apps have often been regarded as less effective than professional personal trainers. But HiAI 3.0 helps turn such apps into viable personal trainers in their own right. HiAI 3.0 connects the user's smart TV, phone, and speaker to form a wholly-integrated, super intelligent system. The system can use the TV's camera to capture the user's posture, the phone's AI computing power to analyze the images, and determine whether the user's posture is standard based on their skeleton information, before finally having the speaker remind the user to correct their posture by voice.
When the user gets into their car, their phone can automatically connect to the car and utilize the in-car microphone to pick up sounds, while the in-car camera uses the phone chipset's AI computing for driver monitoring. If any driver fatigue or distractions are detected, an alert will be played.
On-device, distributed AI allows devices to "see", "hear", "sense", and "calculate" with greater precision and sensitivity. Fragmented experiences are merged into one consistent, cross-device experience, and device silos are connected to form a super device.
This basic understanding underpins the new paradigm that is Huawei's Seamless AI Life strategy — unbounded intelligence in all scenarios. Powered by AI, diverse hardware resources, including those from smartphones, are pooled, and mutually reinforcing, providing the seamless flow of information across all usage scenarios, and the connected intelligence that will power innovation.
Expect better experience from it

Distributed AI: Smart, Seamless Living with No Bounds

AI has reshaped the world around us, and how we interact with our surroundings.
When you take a photo with your phone, the AI camera can identify what's in the frame (for example, the blue sky or spread of food), and apply intelligent enhancements that correspond to the scene, generating detailed and vibrant images. You can remain productive, even when your hands are occupied, thanks to voice assistants like HiVoice or Siri on your phone. Make payments with AI-powered face recognition, in which your phone stores and analyzes your facial profile, even recognizing your behavioral patterns, to determine when it is you making a purchase, or logging in to an account.
In 2017, the release of Huawei's Kirin 970 captured the industry's imagination. As the first-ever mobile chipset to integrate an independent neural processing unit (NPU), the Kirin 970 represented a milestone for mobile AI. The following year, Huawei unveiled its HiAI platform, opening up Huawei's chipset, device, and cloud capabilities to global developers, and providing invaluable assistance by bolstering a wide range of apps with newfound intelligence.
Since its advent, HUAWEI HiAI has focused on applying innovative new technology from the bottom layer of the system on up. Distributed intelligence forms the key to transforming device software and hardware from isolated capabilities into a collaborative, mutually-reinforcing ecosystem. In this way, HUAWEI HiAI enables software and hardware makers to facilitate innovation in their respective areas of expertise, and contribute to the seamless user experience of tomorrow.
AI cares…
Technology seems like magic, in a sense. It helps unlock unforeseen potential, enriching the lives of countless individuals, in particular, those with disabilities. New apps are constantly being introduced, offering life-altering capabilities.
Huawei has teamed up with IIS Aragon and DIVE Medical to jointly launch the TrackAI project, which is dedicated to helping ophthalmologists run visual tests for children, using Huawei smart devices equipped with HiAI. Numerous medical institutes around the world, in China, Spain, Vietnam, Mexico, and Russia, among other countries, have begun amassing the plethora of data required to train the AI algorithm, through their work with over 2,000 visually-impaired children.
TrackAI's complete detection system consists of the Device for an Integral Visual Examination (DIVE), a Huawei P30 mobile phone, and a Huawei MateBook E tablet. The system displays visual stimuli on a screen, and uses an eye track to detect the child's focus. The system can also learn the differences between children with and without an eye disease. Lastly, the Huawei P30 smartphone runs a pre-trained machine learning model, powered by HiAI, to detect whether the child has a visual impairment.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
The HiAI-powered TrackAI system can help stop an eye disease in its tracks
Compared with traditional models, in which data is uploaded to the cloud for analysis, with the results transferred back to devices, HUAWEI HiAI's on-device analysis is remarkably efficient. In leveraging the local Kirin chipset for AI processing, users have access to real-time analysis, with less latency. Even in rural areas where Internet access is spotty, doctors can still use the TrackAI system for testing. This provides for tremendous benefits for children's healthcare in developing countries.
On-device processing also provides for enhanced privacy safeguards. Users can rest assured that data is stored only on their device, avoiding the risks associated with cloud storage, such as data leak.
Huawei has drawn on AI to improve the lives of those living with disabilities, in a myriad of other ways.
In collaboration with the Polish Blind Association, Huawei developed Facing Emotions, an app designed to assist the blind and visually-impaired perceive emotions through the power of sound. The app uses the rear camera and AI on Huawei phones to translate human emotions into unique sounds. For the millions of people who are unable to see faces and read emotional cues, this offers a truly life-altering capability, bringing them closer to friends and loved ones. Imagine the joy of "hearing" a smile for the first time!
There's also StorySign, an app that helps deaf children read by translating the text from selected books into sign language. Huawei partnered with the European Union of the Deaf, Penguin Books and Aardman Animations, as well as other organizations, in developing StorySign. When a child opens a selected reading book in front of them, then opens the app and holds the phone over the page, an avatar signs the story, while the app highlights each word that has been signed. Thanks to multi-lingual Optical Character Recognition (OCR) and document adjustment technology, StorySign now supports more than 10 European sign languages. StorySign enriches of lives of deaf children and their parents, opening up a wondrous world of storytelling and literature, in which they learn to read and sign together.
HUAWEI HiAI powered StorySign supports more than 10 European sign languages
Huawei has also provided crucial assistance to the Chinese-developed Qimingtong app, which is designed to help the visually-impaired better interact with the world around them. The app reads text out loud, such as that from newspaper articles, letters, and product user guides. It also leverages HUAWEI HiAI capabilities, including face detection and facial feature detection, and enables the visually-impaired to take pictures following simple voice instructions.
All of the above apps are powered by AI, and it is HUAWEI HiAI's primary mission is to make app development effortless.
HUAWEI HiAI provides developers with access to the truly boundless potential from Huawei's chipset, device, and cloud technology. On the chipset side, developers benefit from cutting-edge NPU acceleration. Device capabilities bolster face, image, text, and speech recognition, while cloud technology enables apps to provide timely scenario-based services.
AI empowers...
Developers are dreamers, and HUAWEI HiAI is the platform that helps them fulfill their dreams. Since its debut in 2018, HUAWEI HiAI has connected more than one million developers, and 4000 partners.
SketchAR, a tool for teaching drawing using augmented reality (AR) and AI, offers a prime exactly of how HiAI has revolutionized user experience. It enables users to transmit an image from their device onto any surface, such as a sheet of paper or white wall. The image can then be used on their device as a template for manually drawing on the surface of choice. SketchAR utilizes HUAWEI HiAI's NPU acceleration, to boost image recognition speeds by up by 40%, for improved accuracy and greater responsiveness.
The Chinese-developed app Lvmuxia (Green Screen Compositor) helps users composite a captured video with a background video. Typically, green screen compositing requires powerful computing capabilities, and could previously only be accomplished on the cloud. But as on-cloud computing poses a number of challenges for developers, including high costs, high latency, and privacy risks, it was not practical. By working with HUAWEI HiAI, the Lvmuxia app has overcome those challenges, providing on-device AI capabilities, and shortening the app's time to market.
While attending a conference or lecture, you may want to take photos of the PowerPoint slides for future reference, but the quality of the images can be poor, particularly if you were seated in a corner, or there is some sort of visual obstruction. HiAI provides an elegant solution, with its document adjustment feature, in which photos are straightened, clarifying text and removing unwanted corners. With the OCR feature, you can even add notes or correct mistakes in the text.
From single-device AI to distributed AI
In November 2019, Huawei introduced HiAI 3.0, an open AI capability platform that allows smart devices to share AI computing power between them, representing the tremendous leap from single-device AI to distributed AI.
In its infancy, HUAWEI HiAI 1.0 only supported single type devices. 2.0 expanded to support such devices as phones, tablets, and smart screens. HUAWEI HiAI 3.0 goes even further, pooling hardware resources to form a super device. Powered by distributed AI, devices mutually reinforce each other, providing users with the best possible experience, given the resources at its disposal.
Smart devices are designed to fulfill specific needs, but each category of device comes with drawbacks. For example, smart TVs, watches, and earphones excel in collecting images, videos, and sensor data, but fall short in terms of sheer AI computing power. Smartphones are equipped with increasingly powerful photography features, but still don't compare to dedicated televisions and surveillance cameras, in many regards. Their sound collection capabilities also pale in comparison to a speaker's microphone array.
Huawei developed HiAI 3.0 in response to the ever-present need for enhanced capabilities on smart devices. It works by pooling the hardware resources from different devices to form a super intelligent system. When enriched with shared AI capabilities, all of the participating devices are equipped to provide seamless, cross-device intelligence that is responsive to any and every user whim.
By drawing from such basic distributed technologies as distributed virtual bus and device virtualization, HUAWEI HiAI 3.0 facilitates high-speed connectivity between devices, allowing them to share capabilities and reinforce each other. This has seemingly countless applications in real life.
For example, fitness apps have often been regarded as less effective than professional personal trainers. But HiAI 3.0 helps turn such apps into viable personal trainers in their own right. HiAI 3.0 connects the user's smart TV, phone, and speaker to form a wholly-integrated, super intelligent system. The system can use the TV's camera to capture the user's posture, the phone's AI computing power to analyze the images, and determine whether the user's posture is standard based on their skeleton information, before finally having the speaker remind the user to correct their posture by voice.
When the user gets into their car, their phone can automatically connect to the car and utilize the in-car microphone to pick up sounds, while the in-car camera uses the phone chipset's AI computing for driver monitoring. If any driver fatigue or distractions are detected, an alert will be played.
On-device, distributed AI allows devices to "see", "hear", "sense", and "calculate" with greater precision and sensitivity. Fragmented experiences are merged into one consistent, cross-device experience, and device silos are connected to form a super device.
This basic understanding underpins the new paradigm that is Huawei's Seamless AI Life strategy — unbounded intelligence in all scenarios. Powered by AI, diverse hardware resources, including those from smartphones, are pooled, and mutually reinforcing, providing the seamless flow of information across all usage scenarios, and the connected intelligence that will power innovation.
Source: https://consumer.huawei.com/en/press/news/2020/huawei-hiai-3-0-arrived/
Thanks for this article, who is interested to know the latest trends in AI, follow the link: https://masterofcode.com/blog/state...nce-ai-in-ecommerce-statistics-and-deployment

Story Behind ScanScan: Huawei Developer Platforms Power Mobile App Accessibility

Tao Xinle is excited about the upcoming HUAWEI DEVELOPER CONFERENCE 2020 (Together), not only because he can share stories and thoughts with developers across the world at this annual event, but also because he will bring his new innovation to the HDC. It is a text recognition app called ScanScan that has been downloaded more than 9 million times in AppGallery.
ScanScan was born out of a romance. Three years ago, Tao quit his job in Beijing and moved to Yunnan Province to live with his girlfriend Baibai. As a book lover who enjoys reading and noting down her favorite sentences, she tried various types of OCR software but was frustrated by the complicated procedures, low precision, and high costs. Therefore, Tao decided to develop a handy OCR tool for her.
Tao used the white cat he raised with his girlfriend as the logo for ScanScan to symbolize their love and togetherness.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Story Behind ScanScan: Huawei Developer Platforms Power Mobile App Accessibility
Baibai giving feedback about ScanScan
As a beta user of ScanScan, Baibai offered a lot of useful feedback, which inspired Tao to add more functions to the original version, including document scanning, chart recognition, batch recognition, and translation.
During app development, Tao used the OCR and document correction capabilities powered by HUAWEI HiAI to improve the accuracy of text recognition and speed of boundary detection, and also integrated HMS Core's ML Kit, all free of charge. In addition to helping Tao save on resources, these two platforms also allowed the OCR feature to be compatible with various mobile phones, from low-end to high-end models, from Huawei brands to non-Huawei brands, even without the need to connect to a network.
The full-coverage capabilities provided by Huawei allow developers to develop features or apps compatible with all device models. ScanScan offers an offline recognition capability, which keeps user data safe with the recognized results stored locally on your phone, and allows users to use it anywhere, even in remote areas where the network signal is often patchy.
Story Behind ScanScan: Huawei Developer Platforms Power Mobile App Accessibility
Tao Xinle and Baibai trying out the app
At the very beginning, ScanScan aimed to offer more convenience to users like Baibai. However, it turned out to be a blessing for another unexpected group of users.
"ScanScan really helps me see the world," said Anzhi, a visually impaired user of the app. "I use it to read my schedule, musical notation, user guide for electronic device, and the label on medicine packets. Sometimes when I am not sure which floor I am on, ScanScan can help me identify the floor by taking a picture." Anzhi described her user experience with high praise for the app: "If I was only allowed to use one app on my phone, it would be ScanScan because it really helps me see more in my life."
By integrating HMS Core's AI capabilities and adapting to some accessibility functions on phones, ScanScan can easily recognize text in photos and convert it into audio output, which enables people with visual impairments to read in daily life. It also adds voice alerts to instruct users to adjust the camera angle for a more precise recognition result.
"When I found out that ScanScan can actually help people, it felt like I’ve done something worthwhile," said Tao.
Such powerful technology should be accessed by everyone, though it is sometimes still out of reach for certain groups. Accessibility features are crucial to apps, just like tactile paving is an indispensable part of our streets. By creating an app like ScanScan, Tao has demonstrated that he is as much of a pioneer as he is a developer who has paved the way for more newcomers.

3D Modeling Kit Displayed Its Updates at HDC 2022

The HUAWEI DEVELOPER CONFERENCE 2022 (Together) kicked off on Nov. 4 at Songshan Lake in Dongguan, Guangdong, and showcased HMS Core 3D Modeling Kit, one of the critical services that illustrates HMS Core's 3D tech. At the conference, the kit revealed its latest auto rigging function that is highly automated, is incredibly robust, and delivers great skinning results, helping developers bring their ideas to life.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
The auto rigging function of 3D Modeling Kit leverages AI to deliver a range of services such as automatic rigging for developers whose apps cover product display, online learning, AR gaming, animation creation, and more.
This function lets users generate a 3D model of a biped humanoid object simply by taking photos with a standard mobile phone camera, and then lets users simultaneously perform rigging and skin weight generation. In this way, the model can be easily animated.
Auto rigging simplifies the process of generating 3D models, particularly for those who want to create their own animations. Conventional animation methods require a model to be created first, and then a rigger has to make the skeleton of this model. Once the skeleton is created, the rigger needs to manually rig the model using skeleton points, one by one, so that the skeleton can support the model. With auto rigging, all the complexities of manual modeling and rigging can be done automatically.
There are several other automatic rigging solutions available. However, they all require the object to be modeled be in a standard position. Auto rigging from 3D Modeling Kit is free of this restriction. This AI-driven function supports multiple positions, allowing the object's body to move asymmetrically.
The function's AI algorithms deliver remarkable accuracy and a great generalization ability — due to a Huawei-developed 3D character data generation framework built upon hundreds of thousands of 3D rigging data. Most rigging solutions can recognize and track 17 skeleton points, but auto rigging delivers 23, meaning it can recognize a posture more accurately.
3D Modeling Kit has been working extensively for developers and their partners across a wide range of fields. This year, Bilibili merchandise (online market provided by the video streaming and sharing platform Bilibili) has cooperated with HMS Core to adopt the auto rigging function, allowing for virtually displaying products. This has created a more immersive shopping experience for Bilibili users through the application of 3D product models that can make movements like dancing.
This is not the first time Bilibili cooperated with HMS Core as it previously implemented HMS Core AR Engine's capabilities in 2021 for its tarot card product series. Backed by AR technology, the cards feature 3D effects and users are able to interact with the cards, which are well received by users.
3D Modeling Kit can play an important role in many other fields.
For example, an education app can use auto rigging to create a 3D version of the teaching material and bring it to life, which is fun to watch and helps keep students engaged. A game can use auto rigging, 3D object reconstruction, and material generation functions from 3D Modeling Kit to streamline the process for creating 3D animations and characters.
HMS Core strives to open up more software-hardware and device-cloud capabilities and to lay a solid foundation for the HMS ecosystem with intelligent connectivity. Moving forward, 3D Modeling Kit, along with other HMS Core services, will be committed to offering straightforward coding to help developers create apps that deliver an immersive 3D experience to users.

Categories

Resources