Story Behind Magic ABC: Using AR to Reinvent Education - Huawei Developers

When Yang Xiangyong was stuck at home during the pandemic, he could not have imagined that in just a few months' time, Magic ABC, the app he was creating to help his daughter with her studies, would be accessed by children all over China through AppGallery. Nor could he have dared to dream that the app would be so well-received that it would be nominated for Huawei's Shining-Star Program.
What Yang did know, as the father of a Gen Alpha daughter, was that modern kids learn in new ways. They process information by touching screens, playing games, and experiencing digital spaces. Born in the age of smartphones and tablets, Gen Alpha children know which button to tap to get what they want. They talk naturally with AI Assistant, and are more tech-savvy than their grandparents. This means that they are more accustomed to immersing themselves in digital worlds, and interacting with artificial intelligence.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Magic ABC is an AR-based English learning app which is designed to engage and motivate Gen Alpha children. Use it to scan a plain surface, and the app will turn it into a fantasy digital playground, where English letters transform into cute characters that make friends with your kids. For example, the letter "A" becomes Andy Ant, a cute boy, while "S" is Sheep, an adorable girl. The app augments the physical world and encourages collaboration with in-app characters to improve kids' engagement and learning.
As one of 1.6 million Huawei developers, Yang knows that AR can provide us with all-new opportunities which would have been unthinkable not too long ago.
Previously seen as a gimmicky technology which was only applicable to gaming and entertainment, AR is now redefining what's possible in sectors as diverse as healthcare, manufacturing, engineering, and education. By overlaying virtual objects on real-world environments, the technology is changing how we interact with and view the world.
Given his previous experience, developing the app itself was not a big challenge for Yang. However, integrating AR technology into the app was quite difficult and time-consuming, and could easily compromise user experience. However, this initial frustration was overcome with the help from Huawei's technical team, and Yang managed to integrate HMS Core's AR Engine into his app in less than one week. This gives Magic ABC the power to quickly scan and anchor a surface for the digital world, and accurately track your motions so that this anchored surface will always be there when your camera comes back to the same place. This means even if phones and tablets are in the hands of energetic children, the app can still present a stable digital world, including virtual words and characters.
Integrating AR Engine helped to reduce the required work and greatly shorten the project timeline, allowing Yang to devote himself to app innovation and user experience.
What's more, thanks to HMS Core's Analytics Kit and Push Kit, Yang gets easy access to data such as downloads, active users, and user requirements and suggestions, which he can use to improve customer relationships and promote his app to target users.
Yang is now planning to integrate HMS Core capabilities including speech recognition, speech evaluation, and machine learning, in order to perfect this app.
As a father and a developer, Yang dreams of being able to develop more and better apps to share with families and promote innovation for generations to come. Huawei aims to team up with developers like Yang to make their dreams come true and HMS Core is always here for developers to make their innovations more tangible, practical, and real.

Related

Global AppGallery users can now enjoy innovative photo editing tool Cut Cut

Huawei's kits ensure Huawei smartphone users can unlock enhanced functionality and enjoy new benefits
A fast-growing and innovative photo editing tool is now available to users outside of China through AppGallery.
The innovative photo editing tool Cut Cut gives everyday users access to professional retouching and editing software, enabling them to easily create crisper, cleaner, and prettier images from their Huawei smartphone. It is quickly becoming one of the most popular and highest-rated photography apps in the world, amassing almost 100 million global users in less than 18 months.
Cut Cut integrates some of Huawei's leading technology to give users a unique and seamless photo editing experience. As well as allowing users to remove or edit backgrounds, add filters and stickers to images, access a massive material library, and create new collages and artworks, it also includes features made possible by Huawei's chip, device, and cloud capabilities. For example, Huawei's Machine Learning Kit reduces on-device processing time and improves image segmentation precision even if the user is offline. The image segmentation service also unlocks other enhanced functionality features such as image area optimization, portrait colouring, and sky filter effects - Cut Cut can even identify pixels of different kinds of elements more accurately to enhance images of things like the sky or grass.
The app uses HiAI, Huawei's latest AI technology. This ground-breaking platform provides capabilities at the chip, device, and cloud level, allowing Cut Cut to automatically detect people in photos and intelligently cut out backgrounds and differentiate objects within images.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Cut Cut also integrates a range of other HMS Core and HMS Capabilities kits to enable a smoother, easier, and more tailored user experience. For example, the Analytics Kit feeds developers useful insights on user behaviour, helping them better understand user preferences and therefore allowing them to constantly improve applications. Other kits integrated into Cut Cut that deliver user advantages include the Account Kit, allowing users to easily sign in using their Huawei ID; the Push Kit, notifying users of any important promotions or messages; Ads Kit, helping ensure ads are high quality and personalized and therefore less intrusive; and a range of other user benefits, such as convenient in-app purchases and easy sharing to social media and other platforms.
Furthermore, Cut Cut developers APUS has given out a certain amount of all Huawei smartphone users a six-month VIP gift packages as early-bird-incentives to Huawei smartphone users who download the App from AppGallery, which unlocks all paid materials to give members free access to more than 20,000 resources such as background, stickers, and filters.
Cut Cut, along with thousands of other quality apps across 18 categories, are available on Huawei's open, innovative, and secure app distribution platform, AppGallery. One of the top three app marketplaces globally, AppGallery connects 400 million monthly active users throughout more than 170 countries and regions to Huawei''s smart and innovative ecosystem.
For more information about AppGallery, please visit consumer.huawei.com/en/mobileservices/appgallery/
Interested in knowing more about HMS kits and capabilities? Please visit: developer.huawei.com/consumer/en/hms

Perfect World Offers Players Better Gaming Experience with Huawei’s Innovative Techno

Features such as multi-terminal casting, foldable screen gameplay and augmented reality made possible by Huawei’s chip, device, and cloud capabilities.
“Chronicle of Infinity”— the latest virtual role-playing game developed by Perfect World, is slated to land on AppGallery, giving Huawei smartphone gamers some of the freshest taste on the most innovative gaming experiences in mobile gaming. Chronicle of Infinity is an adventure battle game that will integrate Huawei’s Cast+ Kit to fragment in-game scenes and cast them across players' smartphone and TV screens, which transcend the physical boundaries and give users a seamless and uninterrupted cross-device experience. Not only does multiscreen gaming maximize the game's stunning visual audio effects, but it also enables enhanced gameplay such as better battle control and wider strategic visions of battlefields.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
“Integrating Huawei's capability kits into unlocks some of the most innovative mobile technology available and enables Perfect World to redefine what's possible in the mobile gaming experience.”—Robert H. Xiao, CEO of Perfect World
Robert also expressed that the mobile gaming industry is now one of the fastest-growing industries and farmers are increasingly looking for new and unique features. “Technology such as Huawei’s face AR, foldable screen technology, and multi-device casting allows players to enjoy truly special gameplay experiences,” Robert said, “Partnership with AppGallery provides a great opportunity to expand our growing user base.”
The adventure game “ReEvolve” is Perfect World’s first sandbox mobile game that involves players partnering with one another to explore a virtual world and enjoy a series of fun and interactive social gameplays. Huawei’s foldable full view display on the Mate Xs gives players full use of larger screen space, helping facilitate special features such as enabling players to build their homeland from ‘God’s perspective’. It is also worth mentioning that ReEvolve allows split-screen mode on the Mate Xs, where players can “build” in the lower screen, while the upper screen brings a top-down view, helping players get a better view of the whole situation. “Huawei has used its distributed capability to help developers like us, facilitating multi-terminal game playing, which exactly coincides with our expectation,” says Robert.
Having integrated with Huawei’s face augmented reality (AR) technology into the products, mobile games are brought to life to offer a superior experience. Perfect World has made lots of attempts to render fabulous AR effects to immerse gamers in an unprecedented game experience: it has reached an agreement with Huawei in the technology of Face AR, using the front camera of player’s smartphones to scan players’ facial position and posture, topological structure and expression and integrate these features into gameplay.
Perfect World was the first Chinese gaming company to pioneer the independent development of 3D game engines. Now as a global game developer, the company has distributed mobile, console, VR, and cloud games to over 100 countries and regions. Perfect World has used HUAWEI HMS Service from very early days, to offer global users more choices in terms of connection and service.
Click here to hear what Perfect World’s CEO, Robert, says about their cooperation with Huawei.
Perfect World Games is currently adding the finishing touches to Chronicle of Infinity, more and more fun and interactive game will available on AppGallery. Any thoughts regarding launching on AppGallery? You are more than welcome to share your opinion or questions here!
For more information about AppGallery, please visit https://consumer.huawei.com/en/mobileservices/appgallery/

Brilliant Recipes Preserved for Posterity, with Chefs' Powered by HUAWEI HiAI

Grilling, stirring, baking, poaching… transforming ingredients into elegant dishes, cooking might be the most universal and enduring magic of human culture. But even so, making a simple pancake can be quite a challenge for a novice. With today's endless array of apps, there's no shortage of recipes at our disposal, for all tastes and diets. But if you're drawn in by the recipes of old and comfort foods, there's no app quite like Chefs'.
One-Touch Cookbook Digitalization
The creators behind Chefs' were a group of students from Warsaw University of Technology who are highly passionate about food, and were inspired in particularly by the dusty cookbooks in the basement. They hoped to create a handy culinary assistant that differs from any other cooking-related app on the market. Chefs', the fruit of their efforts, functions as a high-level digital cookbook for serious chefs and casual foodies alike.
In addition to offering a range of common services, such as searching and sharing functions, Chefs' also offers a unique one-touch image-based recipe generation feature, which enables you to take a snapshot or input an image from a cookbook, and be rewarded instantly with a clear, intuitive recipe on screen. This could spare you the endlessly tedious task of typing out recipes, and enables you to create a digital cookbook that can be shared and referenced with ease. Furthermore, the process of adding a recipe from an image is responsive and reliable, regardless of the network conditions.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
HUAWEI HiAI Open Platform: Endowing Your Apps with Intelligent Attributes
Chefs' leverages HUAWEI HiAI's state-of-the-art AI techniques, Text Image Super-Resolution and General Text Recognition, to accurately identify text blocks and fill in the blank spaces between with the corresponding content. Better yet, HUAWEI HiAI Engine is based entirely on the device, which means that the AI capabilities incur no server-related costs. The HUAWEI HiAI platform jumpstarted the development process, enabling Chefs' creators to forgo endless rounds of AI model training and the costly burden of server rents, enabling them to realize their vision – which resulted in the app winning the first prize at the Huawei AI CHALLENGE – Warsaw 2020.
If you can't wait to uncover the wisdom lurking in the yellowed, dog-eared pages of a family cookbook, or yearning to collect all of your recipes in a single place, you'd be remiss not to check out Chefs' on HUAWEI AppGallery.
Fore more information,please visit DevHub
cr. Amber - Brilliant Recipes Preserved for Posterity, with Chefs' Powered by HUAWEI HiAI

HMS Developers Story — How Technology is Creating a Smooth Writing Experience

Text is more than just lines on a page. It can embody our understanding of the world. But how to better record text and improve writing experience is the next big challenge in the digital age.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
According to Li Jianing, CEO of Jnotes, the main incentive to develop the Jnotes app was to provide users with a lifelike digital writing experience that supports their everyday habits. New advancements in network technology and smart devices (like phones, tablets, and watches) are commonplace, which is why many enterprises are adopting a smart office model. The Jnotes app is designed for a paperless society, presenting handwriting at maximum fidelity and minimal latency to fit users' requirements.
Li Jianing, CEO of Jnotes​
Jnotes was established in 2019, recalled Jianing, and with a team of four. Since then, the app has been installed over 30 million times. Jianing says, "This achievement is part due to our continuous investment in advanced technologies, and part to our core focus on user experience". In addition to its excellent writing experience, Jnotes also provides a set of quality functions, such as handwriting duplication, PDF annotation, and image insert. These features make the app a perfect foundation to facilitate both work and studying, for any environment.
Jnotes team​
Open capabilities from HMS Core have contributed to Jnotes' meteoric rise. For example, Pencil Engine. Its stroke estimate feature improves stroke efficiency and the writing experience. According to Jianing, "This feature helps narrow the distance from the handwriting to the stylus pen tip, and slash the writing latency." Now, writing is smooth as using pen and paper, conforming perfectly to common writing habits.
Another key feature was Drive Kit, which facilitates the synchronization function on the app. Jianing added, "Drive Kit allows users to check and edit their notes on different types of devices, making the app a premium tool for improving productivity".
Smooth writing experience from Jnotes​
One core focus for the company was the need to quickly respond to users' requirements. In fact, this is one of the reasons why Jnotes stands out from the crowd. The app adopts Analytics Kit, which allows the support team to check vital operations data in AppGallery Connect — the Huawei platform designed for developers — to swiftly locate issues and make improvements. Jianing explains, "This helps stay on top of, and refine, our operations". This was especially useful when combined with user feedback, helping the company better equipped for the future.
Users' feedback from AppGallery Connect​
At the 2021 Huawei HMS App Innovation Contest, Jnotes reaped the Best App award. For Jianing and her team, this was the recognition they dreamed, and encouraged the whole Jnotes team to keep pushing their limits.
AppsUP 2021 Best App​
Each year, the app's user base grows bigger, meaning the Jnotes team will have to stay dedicated to improving its performance. The company will work with HMS Core to offer true-to-life, smooth writing experience.

Notebloc, the first app integrated with Pencil Engine's handwriting suite, transforms user experience

Notebloc is a Spanish app that scans, saves, and shares notes, documents, receipts, drawings, photos, and images of any type. It allows users to crop documents or images, and automatically corrects misaligned pages. Notebloc, which is now available worldwide and supports over 30 languages, has already been downloaded by more than 7 million users around the world.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
Notebloc's core functions are centered around documents. The integration of the HMS Core Pencil Engine into the Notebloc app offers specialized features such as brush effects, handwriting editing, stroke estimate, smart shape, and double-tapping. These advanced tools provide a superior handwriting experience. Now, users can effortlessly edit documents, by using the marker to annotate, mark up, and add notes to a file, and they can also unleash their creativity by adding sketches or diagrams. This is how Huawei's Pencil Engine allows Notebloc to bring users' best ideas to life.
Notebloc also integrates the HMS Core ML Kit text recognition service, which enables the app to accurately identify and extract text from images of receipts, business cards, and documents, and provide precise, and structured transcription of important information in text, greatly improving user satisfaction.
Teamwork Timeline:​2013:Notebloc was founded in Barcelona, Spain
2021:In September, team meetings were held regarding co-development between Notebloc and Huawei. In November, the project began. Huawei's HMS Core DTSE team helped Notebloc's developers overcome difficulties, such as a lack of test devices and insufficient sample documents.
2022:In January, HMS Core was successfully integrated into the Notebloc app, and became available on the HUAWEI AppGallery.
Customer feedback:
STEM Alliance reported that Notebloc, one of the first apps in Europe to integrate Pencil Engine, was able to provide users with substantially improved note-taking services by working with HMS Core. More users can now access and use a myriad of editing tools, and can easily, and securely, scan and share documents.
The Notebloc team confirmed its intention to integrate other HMS Core capabilities in order to attract app users and increase monetization in the future.
To learn more, please visit:
>> Reddit to join developer discussions
>> GitHub to download the sample code
>> Stack Overflow to solve integration problems
Follow our official account for the latest HMS Core-related news and updates.

Categories

Resources