[APP] WearMouse, a Wear OS Air Mouse App - Wear OS Software and Hacking General

[APP] WearMouse, a Wear OS Air Mouse App - Wear OS Software and Hacking General

Today I’m going to bring a little bit of magic to your Wear OS watch.
As you know from the earlier post, Android Pie has introduced a new public API for using your Android device as a Bluetooth HID Device (e.g. mouse, keyboard, gamepad, etc.), so I built a simple app that demonstrates one of the possible ways you can use this API. Also, see below for a little surprise regarding compatibility...
So, you have probably already guessed from the title what the app does: it allows you to control the mouse pointer simply by waving your hand. It is compatible with any Windows, OSX, Linux (including Raspbian), Chrome OS, Android (including Android TV) device, as long as it has a Bluetooth radio; no root, no “server” software required. Just launch the app, perform Bluetooth pairing, and then you’ll be able to:
Use it as an intuitive pointer for presentations (and also click through the slides using cursor keys);
Play Fruit Ninja with your arms (e.g. by sideloading it on Android TV, or installing it on a Chromebook from the Play Store);
Control a media player from the sofa (e.g. when using a computer connected via HDMI);
Use it as a VR controller in some Cardboard games to walk around (not for Daydream though, since it has its own controller);
Impress your friends with some telekinetic powers.
Control your DeX-connected phone;
Download
Play Store
Source (Note: the source code doesn't include the Oreo hack)
How to use it
The app features three input modes: air mouse, cursor keys and keyboard input.
The air mouse mode is pretty straightforward. It has two on-screen buttons for left and right click, a top drawer to adjust motion tracking for the way you’re wearing your watch (on your left wrist, on your right wrist, or holding it in your hand like a laser pointer), and a bottom drawer for some extra functions: click and hold (a.k.a. Fruit Ninja mode) and middle click. If your watch is equipped with a rotating crown, you can use it for scrolling as well.
The cursor keys mode is simple enough: tap on the sides of the screen to trigger corresponding keys, double-tap in the center to trigger the Enter key, long-press to quit, and there are also swipe gestures for Escape, Backspace, Space and Tab keys.
Finally, the keyboard input mode allows using either an on-screen keyboard, or voice input. Note, though, that the text you’ll see entered on your connected device depends on your keyboard layout. Only US English is supported at the moment (I can add some more, but that will require you to manually switch the layout both in the app and on the device every time).
If your watch has some extra keys, you can use those to quickly switch between the input modes.
There are also some settings available. You can choose to stabilize the pointer movements (this will smooth out smaller motions like hands shaking), enable diagonal movements for the cursor keys (which is useful for those Cardboard games), or reduce the data rate (which is helpful when you use the app with some older Nougat-based Android TV box, and the mouse pointer just can’t keep up).
A word on compatibility.
Like I said, the API was made public in Android Pie, but (as a belated Christmas present) the app will work on any watch running Oreo as well. That is, when reboot your watch, and after the trippy dots animation you see a big colorful “W” and “Wear OS by Google” instead of the “Android Wear” logo, you should be fine. The API was introduced in Oreo, and it was a bit different (and also hidden) at the time, but before Pie is was only enabled on watches by default. There is a way to enable it on phones as well, but it requires root.
A few tips for troubleshooting.
If you connect and see that the mouse pointer is moving once per second in a really janky way, try turning Airplane mode on your watch on and off, and then reconnect. Looks like there is some occasional issue with power management in the Bluetooth stack…
If you want to adjust the “sensitivity”, please look for the pointer speed setting on the connected device, not in the app itself.
If you are using the app with a device that is connected to a TV, you’ll probably want to switch your TV to the “Game” picture mode. This should turn off any post-processing that may cause a lot of lag on modern TVs.
I also recommend turning off wrist gestures in your watch’s settings when you use the air mouse mode, otherwise there’s a high chance of triggering the “back” or “go home” gesture.

This looks great!
By chance is it possible to have an app that connects to the computer and when it disconnects it locks the PC!

c_86 said:
By chance is it possible to have an app that connects to the computer and when it disconnects it locks the PC!
Click to expand...
Click to collapse
Depends on what you mean.
If you want to make an app that sends Win+L (or Ctrl+Alt+L) when you press "disconnect" on your watch (or maybe connects, sends the key press, then immediately disconnects), then it should be easy enough to implement.
If you mean that the PC should lock itself when your watch disconnects (e.g. goes out of range), then obviously you'll need to have something on your computer to do that. Then again, Windows 10 has a feature called Dynamic Lock that does something similar based on your phone nearby presence.

Idea - Does it possible to implement the same functionality for Smartphone with Android 8? And after that to create Wear app for smartwatches with lower Android version, where the new API is missing - it will act as a remote for the companion app on the smartphone

bobybc said:
Idea - Does it possible to implement the same functionality for Smartphone with Android 8? And after that to create Wear app for smartwatches with lower Android version, where the new API is missing - it will act as a remote for the companion app on the smartphone
Click to expand...
Click to collapse
So, you mean, use a phone connected to a computer (or a TV, our whatever) using this API, then stream motion data from the watch using the phone as a proxy?
Technically it's possible, I wonder what the latency would be though.
Also note that a phone running Android 8 has to be rooted to do this (unlike watches), whereas Android 9 should just work.

Yea, you're right for the lag...
Then i think that it will be useful to have app with the same functionality for a smartphone
Sent from my SM-N960F using Tapatalk

bobybc said:
Yea, you're right for the lag...
Then i think that it will be useful to have app with the same functionality for a smartphone
Click to expand...
Click to collapse
It's not just lag, but power consumption as well.
This API makes use of the low-power mode of the Bluetooth radio called Sniff Sub-Rating (SSR) specifically designed for sending rapid bursts of tiny data packets, whereas watch-to-phone connection would have to be fine in a more generic way.
Making a phone app is really easy, you can pretty much use the same source code, with a few simple changes (mostly deletions). The Android Pie upgrade for your Note 9 is going to arrive pretty soon, which will allow you to experiment with it all you want.

I need the apk since I have a Moto 360 1gen so & cannot look at it on Googleplay

Related

[Think Tank] adding mouse cursor controlled by realative finger movement

I was impressed by the way the mouse cursor is controlled in the Remote Desktop application called "Xtralogic Remote Desktop Client for Android"
It uses what I am referring to here as "touch based relative cursor control" to allow you to control the mouse movements when connected to your remote desktop PC.
"Touch based relative cursor control" means that where ever you touch the screen, you are moving the mouse. Its basically like layering a transparent touchpad on top of the screen. Your finger doesn't have to be right on top of the cursor for it to work...
here is a video from their website to illustrate what i'm talking about:
I think that this could be very handy for certain things in android like browsing the internet.
the folks over at android-x86.org already have the code to add cursor support to android, their source code is freely available.
so here is what I would like to see:
-relative touch cursor
-for use in android browser (or other parts of the OS)
-while in browser, can be controlled via some sort or swiping gesture, menu option, or triple clicking
I just wanted to get a feeling on how the xda community would be open to such an idea, and maybe see if it sparks the interest of any devs (since my android coding skills are relativity limited at the moment.).

Good idea, but you're not the first to mention this.. i just hope some one make this happen

This would be great as an option for interacting with flash apps that rely on mouse hover.

[Q] Switching between 4 apps in the car and other environments

What is the fastest and easiest way way to switch between four apps in the car. For example Google Nav, Poweramp, Trapster, and a speedometer app. A wave of the hand would be nice. I have looked at several and used a few. Smart Task Switcher, a reviewer said “Was warned about this app due to access to contacts permissions which dev says is used in China for advertising”. AppSwipe only does two ( the last opened). The “car apps” say nothing about task switching or is it shown in the Youtube videos. It would be nicer if an app would isolate and load these four programs from one key push then allow fast switching. A snap of the fingers would be another way to switch between these four apps. Also, a slideshow type thing of these four apps with the option to stay on the current one showing might be an idea. Or, one app that puts to the front the needed app, like the media player about the first and last 5 seconds of a song, trapster like app that would popup during notifications, navigation about 10 seconds before and after turns, and the speedometer the rest of the time. I'm just thinking out loud. Holding down the home key is not a good fit. Bottom line is I need a better task switcher (not killer) for the auto. An app that would allow me to map a steering wheel button in my 2011 Ford Fusion SEL for task switching would be golden! A friend's suggestion was to get four phones, so that one is already out there.

I tried Car Dock Home v3. It works by using a launcher that uses the back key to return to it's home screen, then another task can be selected via a shortcut. Unfortunately it cancels Google Navigation when the back key is hit to go to CDHv3 home screen. This would have been a better solution as it takes two key presses. It would be the best solution to perform one action to cycle through the desired programs. I installed Smart Task Switcher and that was good in theory but I could not find how to configure correctly and the floating button is far too small and often requires several taps, and that is sitting at the desk. There is a paid version where some of this is supposedly settable but from my experience with this app I don't think this is a solution.
The car was the first place that came to mind. But the need to quickly and efficiently switch task is useful in several environments.
I have hit a dead end and any suggestions would be appreciated.

Hey man,Im surprised you expect a phone to act as a tomtom,mp3 player and christ knows what else simultaneously.

theunderling said:
Hey man,Im surprised you expect a phone to act as a tomtom,mp3 player and christ knows what else simultaneously.
Click to expand...
Click to collapse
The S2 runs everything just fine, there is just not an efficient way to switch between them.

Control Phone with your bike!!!

Hi all!
I have an awesome roadbike and I'm upgrading to the shimano Di2-shifting (i.e. electronic gear shifting).
When equipped with a Bluetooth module you can use an app called shimano "E-TUBE PROJECT" to tweak settings of your gears & shifters using your phone. (e.g. what switch changes what gear, etc.)
http://e-tubeproject.shimano.com/about/
The latest version of the Ultegra (R8050) and Dura-Ace (R9150) groupeset (this is the drivetrain of the bike including the shifters/switches) has a pair of "hidden buttons" that do not serve a dedicated purpose (therefore they are 'hidden'). Using the E-TUBE PROJECT-app, however, you can specity a function for those extra-buttons. These functions that can be allocated to the switches of the groupeset using the app are very limited unfortunately, allowing only to define gearing up/down on the front/rear derailleur.
However, there is a collaboration with Garmin (who make bike-computers..) that expands the functionality of the app: You can control the bikecomputer via any button that you select and trigger different actions, like swiping through the screens, start/stop, etc.
It would be AWESOME if there would be a way to define more options, i.e. functions that can be allocated to the switches including controls for the smartphone, like music control. So you would use the "enhanced" app, select one (of the hidden) switch and allocate e.g. the function 'music-playback start/stop' of your phones mediaplayer.
Is that possible?

Sad that noone seems to recognize the awesome potential. I'd try to do it myself, but I have no clue, how to do such a thing. Still hoping someone get's interested in that topic.

Maximizing Wear OS with Automagic

Maximizing Wear OS with Automagic
Wear OS has been so underrated. This xda Subforum is not as active as other. I think it is partially because most Wear OS powered watch have bad battery life and typically much more expensive than the proprietary OS powered watch.
I bought Ticwatch E in April 2019, and it has been 4 months when I typed this. I initially regret that the battery life is way worse than I thought. I have to charge every day. My previous Mi Band 2 can last for 3 weeks before charging, but of course that is not on the same level as Wear OS. But I don't regret it anymore after the first week, once I discovered many things I can do with it when paired with Automagic. I have reached the point of no return to any non-Wear OS watch.
During the next several months after I bought it, I have built several flows to extend the functionality. Below are the list of things I have done with the watch. Most of the usages use Automagic and the companion app installed on the watch. Hopes these help other to see the potential of Wear OS and at least give some reasons so Google don't kill it one day.
1. Extend Automagic Shortcut
Automagic has shortcut on the watch to execute flows on the phone. I immediately see the extension of Widget to increase menu count of Automagic shortcut. So I use Shortcut to show widget with 3x3 buttons. Each button press corresspond to execute another flow/command. This immediately extend the number of shortcuts available dramatically. I can still add long press, double click, and swipe in all 4 directions. But for now click is enough. The widget shown is my first widget design, so still quite ugly.
{
"lightbox_close": "Close",
"lightbox_next": "Next",
"lightbox_previous": "Previous",
"lightbox_error": "The requested content cannot be loaded. Please try again later.",
"lightbox_start_slideshow": "Start slideshow",
"lightbox_stop_slideshow": "Stop slideshow",
"lightbox_full_screen": "Full screen",
"lightbox_thumbnails": "Thumbnails",
"lightbox_download": "Download",
"lightbox_share": "Share",
"lightbox_zoom": "Zoom",
"lightbox_new_window": "New window",
"lightbox_toggle_sidebar": "Toggle sidebar"
}
2. Camera Control
Copied from the 3x3 widget menu, I use it for Camera control. Coupled with Control UI, I can control the camera menu for any camera app. In my case, of course I prefer GCam (Google Camera). GCam companion app is not working here, maybe because I am using GCam Mod (since I don't use pixel phone). Hence I have to recreate it, and extend the function beyond simple shutter button. I can use my watch to capture (shutter button), zoom in/out, exposure inc/dec or 0, toggling timer, switch to night mode and view last photo. I can also create a custom timer, but it is not necessary in my case. I also can use it to start my other flow, to capture 4 images of GCam comparison. (HDR off, HDR+ on, HDR+ enhanced on and Night Sight)
3. Photo Viewer
Using the same widget concept, I can show any photo at any time. This can be use to view photo in certain folder, with the widget action to navigate to next/prev photos. It can be used to show your love one, for misdirection (showing fake clock time), or just a simple photo viewer.
4. Remote Photo Surveillance
Widget as photo viewer can be extended further. In another flow, I create a flow with looped camera capture and then set the captured photo to the widget. This create a timelapse photo from the phone. Constant action turn on screen will keep the watch screen awake. I can place my phone somewhere nearby and create an instant surveillance device. Unfortunately, the speed of the capture and set image to the widget is limited by the communication speed between phone to watch. It only shows new photo every 2-3 seconds, which is very choppy.
5. Remote Video Stream Surveillance
Extending the looped camera capture idea, I found out that I can stream the camera directly using IP Webcam for android (using Android Camera as IPCam). Then use the companion app of TinyCam Monitor at the watch to view the stream. All can be controlled directly from the watch, since IP Webcam support automation too, so I can start the stream using Automagic. This mode of streaming is much better for surveillance as it can reach about 15 fps, which is way better than 1/2 to 1/3 fps using the widget mode.
6. Secret Camera Capture / Audio recording
Implementing the same idea from the camera control, I combine it with my secret camera capture. Now I have widget to secretly take front/back photo from the phone. I also add another button to start/stop recording audio. This all happen without touching the phone, without any interface/unlock the phone. The widget itself is transparent, making it perfect secret buttons.
7. Remote input/typing
Since there is limited method to type from the watch, I create notification to input the text. The default google keyboard is so small, but at least can be used to type 1 or 2 words when noting down some code or label, and I can't reach for the phone easily.
8. Note Viewer
At times, I need to have notes to view. Under certain circumstances, it is not convenient/safe to pull out the phone. I can risk dropping the phone, left it unattended or maybe get wet during rain. I create several small notes holder at the widget. So at any time, I can simply tap the shortcut widget 3x3 and it will show me the notes. I can long press and it will popup into notification which I can scroll (in case the note is too long). I can even add action at the end of the notification to do certain things, example : copy the note and send it to certain number/email, mark it as done (so deleted from place holder), or to create reminder for it in another 1-2 hour.
9. Speech Input Trigger
Automagic companion app support input speech dialog. But it requires to press the mic icon again to start recognition and another confirm button to send the recognized words to the phone. I have already speech project flows at my phone, so I just use the similar widget menu to trigger multiple mode on my phone. I have multiple language mode, one time/continous mode, visual feedback option, hotword mode and many others. The recognition still happen on the phone, but I can control the mode directly from the watch. Example, I can press 1 button to trigger recognition in Indonesian and continuous mode (repeating recognition until I stop it), or maybe another button to trigger recognition in English, one time, with feedback and can be retriggered again using hotword.
10. Charging Notification Sound
My Watch sometimes don't get charge properly. And I have also uninstalled the default ticsystem which provide charging animation. So I simply replace it with notification sound when my watch is charged and another sound when disconnected. I then save the battery level when disconnected and create notification to calculate the average %/hour used when I charge it again later. This helps me to track the average battery usage per charge.
11. Language Learning
I keep learning new language, even english. I have been watching movie, playing games, read ebook/news and note down those unusual vocabulary. Although I already have a time logger flow to track my learning time (at least 30 minutes/day), I thought of more immersive learning all day long, not just during my learning session.
I create a flow to parse the vocabulary csv exported from the dictionary favourites note. From other source, I also extract the data from google translate per translation. Then separate the keyword and translation, marking them with each frequency tag. All words start at 0. At certain interval (1 hour during work hour, and 1/2 hour after work hour), it will take 3 of the lowest frequency words, set the word and meaning at the widget and show it at my watch. Pressing the button to denote I am OK, increase the frequency tag (to make it show less frequently), or pressing review to repeat the word again next time (without increasing the frequency tag). I can also tap next to continue learning next words, or I can suspend it for several hours if I am in a meeting.
This helps me to stick the vocabulary in more frequent interval. I can spare 10-15 seconds per hour (or half hour) to keep learning rather than just a long learning session at the end of the day. I can also learn while waiting something, without having to pull out my phone (when the condition is not appropriate/risky).
12. Reminder to Speed up
I ride motorcycle to work, sometimes I drive fast, sometimes slow. At times, because of thinking something while driving slowly, I can be almost late to the office. I have to look the watch to know if I am late or not, which sometimes can be risky. To minimize the risk, I create several checkpoint between home and office, mark the coordinate and approximate time needed to get to the office. Once I leave home, Automagic will start to check my location periodically. It will calculate the distance to the nearest checkpoint. Add current time with the time needed to find if I will be late at current speed. If It will be late, it will vibrate my watch twice long pattern. So I know I have to speed up to catch the time.
13. Home Automation
The 3x3 menu I have can be used to control Home Automation device. Yeelight have companion app, but it can only turn on/off the bulb. Using widget, I can create extra button, coupled with the color or brightness or colorflow. I can have much more option to control the light. I can hook it up with sonoff switch later, after I have flashed tasmota.
14. Extension to other flows
There are still a lot of other wonderful things I can do with the shortcut. Most of them extended from the widget 3x3 menu I have created. Some thoughts and examples :
a. Send certain message when on the way already, or share location via Whatsapp.
b. Save current location with timestamp to log
c. Play songs, or certain sound loudly. Can be for prank, finding the device when hidden by friends or certain situation
d. fake a call/sms to escape from awkward/uncomfortable situation.
e. Controlling PC through eventghost.
f. showing various widgets at the watch
I don't use all the function above daily, only some are more frequently/routinely used. For example, the speech input trigger is very good for showoff, but not so practical for my daily usage case. Some of them are still Work in Progress. But at least those function are there when I need it.
For some who might be interested on how I can do above things, of course the answer is mostly Automagic. Automagic is Automation app just like tasker. It uses flow style to design the flow (similar to task in tasker). I have switched to Automagic 2 years ago and never look back anymore. Those above maybe can be replicated in tasker, but of course don't ask me how to do it using tasker. But if you are using Automagic too, I can show how I create the flows. Unfortunately I can't simply share the flow without any explanation. As each flows are designed to my own need and may linked to each other. Sharing all of them at once will just create confusion and possibly leak out some of my private data.
Hopes this inspire you to maximize your Smartwatch. Long live Wear OS!!!

Really great features for wear os, but where is the link to download automagic, i can not find on google play (both phone and watch)

huylv177 said:
Really great features for wear os, but where is the link to download automagic, i can not find on google play (both phone and watch)
Click to expand...
Click to collapse
It is paid app in playstore : Automagic * Automation
Not my app, I am just one of the happy user. The companion watch app is free, can be installed after you have installed the main app. You can go to your watch's playstore and install it from the "App on your phone".
You can try the evaluation version directly from the website, before deciding further. You can visit the index tutorial I have summarized at my post's signature. Since we don't have the subforum for Automagic here in xda (it will be great if we can have it), you probably need to visit the Automagic forum for more information. I am active there too.

Can it be possible that while travelling, I can use wear OS supported watch to show me the distance remaining to the destination?

Jayraj Zala said:
Can it be possible that while travelling, I can use wear OS supported watch to show me the distance remaining to the destination?
Click to expand...
Click to collapse
Yes, in Automagic you can init the location and then calculate the distance between current location to the destination. But the distance calculated this way is straight-line distance, actual road distance may be longer, as you need to turn or curve. You can then show the distance in a widget. Then use periodic timer/location to recalculate and show the latest distance.

Look, I know you said that you are a user, not the dev, but it's just killing me; I have to ask.
Everything about your post absolutely screams (to me) Dev re-works advertisement into use-case posing as user.
So, come on, level with me. It's actually a compliment if I'm right. It would be a very clever and enterprising marketing conceit: scouting out use cases for your utility, constructing a guide tailored to that use case, and posting in sub-forums as a helpful "user."
Please don't screw with my reality and make me doubt myself if I'm right, that would be the biggest **** move in the universe. Just say "got me!"
(or you can DM me, that's fine too.)

ha7msterx said:
Look, I know you said that you are a user, not the dev, but it's just killing me; I have to ask.
Everything about your post absolutely screams (to me) Dev re-works advertisement into use-case posing as user.
So, come on, level with me. It's actually a compliment if I'm right. It would be a very clever and enterprising marketing conceit: scouting out use cases for your utility, constructing a guide tailored to that use case, and posting in sub-forums as a helpful "user."
Please don't screw with my reality and make me doubt myself if I'm right, that would be the biggest **** move in the universe. Just say "got me!"
(or you can DM me, that's fine too.)
Click to expand...
Click to collapse
Thanks for the compliment. It means I really use the app to my own full potential. But for the sake of logic, the one who accuse something should provide the proof first. The burden of proof lies on the one who made the claim. While it maybe normal to suspect such kind of thread explaining certain app, but at least quote my other posts or xda portal comment, try to find something else (outside of this thread) that can support the claim.
Even though I don't have to prove anything to you, I just elaborate here to clarify my position as a user. This way I don't have to explain it everytime. As some users in Automagic forum also mistaken me as the dev, just because I am quite active there. While in fact, I even never know/meet the dev himself in person. He lives in Germany, while I live in Indonesia.
I have been using tasker since 2014, anyone can track my post in the kaskus forum, tasker thread : https://kask.us/hEXs0. If you google my name, the first/second link should be my kaskus profile.
You can see how I also support and help others in tasker too. Automagic has been there since 2011, so why I should use tasker again if I am the dev? If I am the dev, I should be posting about Automagic in every tasker post I made there. In fact, the starting point I post about Automagic is only after I started using it. (check the post date)
Around mid 2017, I switched to Automagic. I was really excited, I share it everywhere, to the point some other tasker users got annoyed too. (ask Mishaal Rahman from xda portal about it)
I compared the experience between Tasker and Automagic. You can read Tasker vs Automagic comparison here : https://automagic4android.com/forum/viewtopic.php?f=6&t=6809
I even created local thread in kaskus too : https://kask.us/iqTnO
There is a post just to document my process of switching from tasker to Automagic. But the posts in kaskus are using Indonesian informal language, it might be difficult to google translate it.
For this thread, I created it first in kaskus - All about Android Wear : https://www.kaskus.co.id/show_post/...75f/750/memaksimalkan-wearos-dengan-automagic
I take the pictures link, since I don't know why I can't post them directly in xda. If I am the dev and the purpose is to promote my own app, I am so bad at it, that I only create this thread for such a long time interval. I should have spammed the forum with more thread instead.
This thread's purpose is not just for sharing, but the main one is to request other WearOS feature to Automagic's dev, Martin, in the Automagic Forum : https://automagic4android.com/forum/viewtopic.php?f=4&t=8184
To make such a long request, I feel obliged to give something in return too. I also need to explain the stand point of why I need the features I requested. Hence I created the thread first before making the requests. Why the heck I should request feature to "myself"? Wouldn't it be easier to just announce the new feature directly? Until this post is made (almost 4 months then), none of those requests have been implemented yet. Not even the newer Automagic version released in the playstore. If I am the dev, I am so bad at creating a scenario like this. I should create the request and fulfilled the requests in such a short period to make it seems very responsive.
I can share this thread link to other so they can know the full potential of WearOS, while helping to promote Automagic in indirect way. I want the app I love and benefit from, to get more users, so the dev can continue the work. The same I have been doing for other apps too, example : MiXplorer, which I switched to it around the same time I switched to Automagic. I post it everywhere, in kaskus, xda, also in Automagic forum (you can search my post there). Does that mean I am the dev of MiXplorer too?
The other purpose is to document it earlier, so in case Google try to kill WearOS, I already have a lot of reasons to put to their face.
If those above are not enough proof of my position, there are still other ways you can verify. And you should give stronger (counter) proof otherwise. But I just leave it to anyone who read this post.

Desmanto said:
Maximizing Wear OS with Automagic
Wear OS has been so underrated. This xda Subforum is not as active as other. I think it is partially because most Wear OS powered watch have bad battery life and typically much more expensive than the proprietary OS powered watch.
I bought Ticwatch E in April 2019, and it has been 4 months when I typed this. I initially regret that the battery life is way worse than I thought. I have to charge every day. My previous Mi Band 2 can last for 3 weeks before charging, but of course that is not on the same level as Wear OS. But I don't regret it anymore after the first week, once I discovered many things I can do with it when paired with Automagic. I have reached the point of no return to any non-Wear OS watch.
During the next several months after I bought it, I have built several flows to extend the functionality. Below are the list of things I have done with the watch. Most of the usages use Automagic and the companion app installed on the watch. Hopes these help other to see the potential of Wear OS and at least give some reasons so Google don't kill it one day.
1. Extend Automagic Shortcut
Automagic has shortcut on the watch to execute flows on the phone. I immediately see the extension of Widget to increase menu count of Automagic shortcut. So I use Shortcut to show widget with 3x3 buttons. Each button press corresspond to execute another flow/command. This immediately extend the number of shortcuts available dramatically. I can still add long press, double click, and swipe in all 4 directions. But for now click is enough. The widget shown is my first widget design, so still quite ugly.
2. Camera Control
Copied from the 3x3 widget menu, I use it for Camera control. Coupled with Control UI, I can control the camera menu for any camera app. In my case, of course I prefer GCam (Google Camera). GCam companion app is not working here, maybe because I am using GCam Mod (since I don't use pixel phone). Hence I have to recreate it, and extend the function beyond simple shutter button. I can use my watch to capture (shutter button), zoom in/out, exposure inc/dec or 0, toggling timer, switch to night mode and view last photo. I can also create a custom timer, but it is not necessary in my case. I also can use it to start my other flow, to capture 4 images of GCam comparison. (HDR off, HDR+ on, HDR+ enhanced on and Night Sight)
3. Photo Viewer
Using the same widget concept, I can show any photo at any time. This can be use to view photo in certain folder, with the widget action to navigate to next/prev photos. It can be used to show your love one, for misdirection (showing fake clock time), or just a simple photo viewer.
4. Remote Photo Surveillance
Widget as photo viewer can be extended further. In another flow, I create a flow with looped camera capture and then set the captured photo to the widget. This create a timelapse photo from the phone. Constant action turn on screen will keep the watch screen awake. I can place my phone somewhere nearby and create an instant surveillance device. Unfortunately, the speed of the capture and set image to the widget is limited by the communication speed between phone to watch. It only shows new photo every 2-3 seconds, which is very choppy.
5. Remote Video Stream Surveillance
Extending the looped camera capture idea, I found out that I can stream the camera directly using IP Webcam for android (using Android Camera as IPCam). Then use the companion app of TinyCam Monitor at the watch to view the stream. All can be controlled directly from the watch, since IP Webcam support automation too, so I can start the stream using Automagic. This mode of streaming is much better for surveillance as it can reach about 15 fps, which is way better than 1/2 to 1/3 fps using the widget mode.
6. Secret Camera Capture / Audio recording
Implementing the same idea from the camera control, I combine it with my secret camera capture. Now I have widget to secretly take front/back photo from the phone. I also add another button to start/stop recording audio. This all happen without touching the phone, without any interface/unlock the phone. The widget itself is transparent, making it perfect secret buttons.
7. Remote input/typing
Since there is limited method to type from the watch, I create notification to input the text. The default google keyboard is so small, but at least can be used to type 1 or 2 words when noting down some code or label, and I can't reach for the phone easily.
8. Note Viewer
At times, I need to have notes to view. Under certain circumstances, it is not convenient/safe to pull out the phone. I can risk dropping the phone, left it unattended or maybe get wet during rain. I create several small notes holder at the widget. So at any time, I can simply tap the shortcut widget 3x3 and it will show me the notes. I can long press and it will popup into notification which I can scroll (in case the note is too long). I can even add action at the end of the notification to do certain things, example : copy the note and send it to certain number/email, mark it as done (so deleted from place holder), or to create reminder for it in another 1-2 hour.
9. Speech Input Trigger
Automagic companion app support input speech dialog. But it requires to press the mic icon again to start recognition and another confirm button to send the recognized words to the phone. I have already speech project flows at my phone, so I just use the similar widget menu to trigger multiple mode on my phone. I have multiple language mode, one time/continous mode, visual feedback option, hotword mode and many others. The recognition still happen on the phone, but I can control the mode directly from the watch. Example, I can press 1 button to trigger recognition in Indonesian and continuous mode (repeating recognition until I stop it), or maybe another button to trigger recognition in English, one time, with feedback and can be retriggered again using hotword.
10. Charging Notification Sound
My Watch sometimes don't get charge properly. And I have also uninstalled the default ticsystem which provide charging animation. So I simply replace it with notification sound when my watch is charged and another sound when disconnected. I then save the battery level when disconnected and create notification to calculate the average %/hour used when I charge it again later. This helps me to track the average battery usage per charge.
11. Language Learning
I keep learning new language, even english. I have been watching movie, playing games, read ebook/news and note down those unusual vocabulary. Although I already have a time logger flow to track my learning time (at least 30 minutes/day), I thought of more immersive learning all day long, not just during my learning session.
I create a flow to parse the vocabulary csv exported from the dictionary favourites note. From other source, I also extract the data from google translate per translation. Then separate the keyword and translation, marking them with each frequency tag. All words start at 0. At certain interval (1 hour during work hour, and 1/2 hour after work hour), it will take 3 of the lowest frequency words, set the word and meaning at the widget and show it at my watch. Pressing the button to denote I am OK, increase the frequency tag (to make it show less frequently), or pressing review to repeat the word again next time (without increasing the frequency tag). I can also tap next to continue learning next words, or I can suspend it for several hours if I am in a meeting.
This helps me to stick the vocabulary in more frequent interval. I can spare 10-15 seconds per hour (or half hour) to keep learning rather than just a long learning session at the end of the day. I can also learn while waiting something, without having to pull out my phone (when the condition is not appropriate/risky).
12. Reminder to Speed up
I ride motorcycle to work, sometimes I drive fast, sometimes slow. At times, because of thinking something while driving slowly, I can be almost late to the office. I have to look the watch to know if I am late or not, which sometimes can be risky. To minimize the risk, I create several checkpoint between home and office, mark the coordinate and approximate time needed to get to the office. Once I leave home, Automagic will start to check my location periodically. It will calculate the distance to the nearest checkpoint. Add current time with the time needed to find if I will be late at current speed. If It will be late, it will vibrate my watch twice long pattern. So I know I have to speed up to catch the time.
13. Home Automation
The 3x3 menu I have can be used to control Home Automation device. Yeelight have companion app, but it can only turn on/off the bulb. Using widget, I can create extra button, coupled with the color or brightness or colorflow. I can have much more option to control the light. I can hook it up with sonoff switch later, after I have flashed tasmota.
14. Extension to other flows
There are still a lot of other wonderful things I can do with the shortcut. Most of them extended from the widget 3x3 menu I have created. Some thoughts and examples :
a. Send certain message when on the way already, or share location via Whatsapp.
b. Save current location with timestamp to log
c. Play songs, or certain sound loudly. Can be for prank, finding the device when hidden by friends or certain situation
d. fake a call/sms to escape from awkward/uncomfortable situation.
e. Controlling PC through eventghost.
f. showing various widgets at the watch
I don't use all the function above daily, only some are more frequently/routinely used. For example, the speech input trigger is very good for showoff, but not so practical for my daily usage case. Some of them are still Work in Progress. But at least those function are there when I need it.
For some who might be interested on how I can do above things, of course the answer is mostly Automagic. Automagic is Automation app just like tasker. It uses flow style to design the flow (similar to task in tasker). I have switched to Automagic 2 years ago and never look back anymore. Those above maybe can be replicated in tasker, but of course don't ask me how to do it using tasker. But if you are using Automagic too, I can show how I create the flows. Unfortunately I can't simply share the flow without any explanation. As each flows are designed to my own need and may linked to each other. Sharing all of them at once will just create confusion and possibly leak out some of my private data.
Hopes this inspire you to maximize your Smartwatch. Long live Wear OS!!!
Click to expand...
Click to collapse
Is music control available with this app? Thanks!

richarshub said:
Is music control available with this app? Thanks!
Click to expand...
Click to collapse
What is your WearOS device? If you have installed Wear OS app at your phone and at the smartwatch, you should already have media control built-in. You can ensure it is enable at the Wear OS app at phone > advanced settings > Autolaunch media controls. Once you play some music at your phone, your quick setting should have the media player notifcation. And if you enable the autolaunch, your watch screen should be showing the songs being played, the play/pause, next, prev and volume control button. You still have to start the music playing from the phone though. That should be enough for most users.
But if you need more, such as starting the music directly from the watch, then yes, you have to use other app. (in this case, Automagci) Automagic has the action Control Audio Player. You can assign a shortcut or widget tap to send the media button event, from play/pause, next, prev, fast forward, rewind, stop and many other. You can also change the volume and maybe play particular songs. I design some widget to allow me to play certain sound effect for certain occassion.
But it takes some time to setup everything and maybe too hassle for most users. Check out if the media control above is enough for you.

ok I have read this so many times because when we ask how to put the damn thing on the watch some idiot always puts the ling to this LONG AND POINTLESS ****.
So you see, we want to be able to use automagic on our watch but we have someone saying I did this and I did that WITHOUT GIVING THE APP OR DIRECTIONS HOW TO MAKE IT WORK. USELESS THREAT!!
Does ANYONE ELSE have something to say about how to put automagic on the watch?
I have Galaxy Watch4 Classic (SM-R890) and I want automagic on it so the first flow I create and work (because I already have flows but only on the mobile. They don't connect with the watch to make it work) is THE BATTERY one!!
If anybody has a solution to this problem, I would like to see a post WITHOUT repeating the long post at the top of the threat!!
Thanks to all who have read this and to the star who will give us a solution!!

Overlay app to detect multitouch (for smart home device)

Hi,
I am planning to use a few of these things for home automation purposes.
I have a prototype installation running using Home Assistant and so far it can do the things that I need. Basically it is currently displaying a Home Assistant dashboard by default on boot and Home Assistant does the rest.
There is just one thing I would like to improve and that is the "regular use case" of a light switch:
So when you enter/leave the room and just touch the device with your hand (like you would when turning on/off a regular european-style light switch), I would like to trigger a certain event.
"touch with your hand" would be a multitouch event with at least two simultaneous touch events.
Do you know of any tool that could handle that?
I already had a look at tasker, but the events I need are not present there.
I was also looking for an "overlay app", but was unsuccessful.
It should also work when the screen is off, so the solution must be able to distinguish if the device was woken up by a single touch or by a multitouch.
Is that even possible?
Thanks for your input,
Morgenstern

Better Mobile App

welcome