[Release][APP][0.9.3 - 2019.07.12] GAssist.net - Google Assistant for Galaxy Watch

[Cybernetic87]

App is already available on Samsung Store.
Thank you for all DONATIONS and support !!!!


Introduction

I've been looking at this topic and I saw that unfortunately the project died... so as I am a java developer and I am very tired with all the unresponsible/crashing apps on Galaxy Store. I decided to try myself at C#/.Net to write my own Google Assistant companion for Galaxy Watch. I hate Bixby as much most of the community.

So here is my approach to the Google Assistant companion app for Tizen Watches.

Preview demonstration videos

https://www.youtube.com/watch?v=b3CC3uvr2to
https://youtu.be/qtfn6-p5CQA

Screenshots

Already implemented features

• Written with cutting edge libraries
• Real time data streaming to/from GA
• Push to talk
• Real time recognized text display
• Responses text display
• Start recording after launch
• Responses as fast as possible

Planned features:

• Rework html responses so they display properly on watch screen

Requirements:

• Tizen 4.0+ based Samsung watch
  Doesn't work on Gear S3 at the moment, there is bug with Samsung.Sap library
  More info on Samsung forums, https://developer.samsung.com/forum/board/thread/view.do?boardName=SDK&messageId=369273&topCtgy=03
• Android 8.0+ smartphone
• Microphone/Speaker on watch

Changelog

0.9.3 - 2019-07-12
- reworked file picker (compatibility with Android Q)

0.9.2 - 2019-07-11
- added vibrate on listen option
- stability fixes

0.7.0 - 2019-06-20
- added html responses
- cleanup / reduce weight of phone apk

0.6.1 - 2019.06.06
- changed font size, text alligning adjustment
- added option to display raw text recognition result ([B]default ON[/B])
- stability fixes
- apk is now service

0.5.4 - 2019.06.02
- new icon / logo (Credit: @aefelix)
- audio recording / playing adjustment
- stability fixes
- phone app improvements / cleanup

0.5.0 -  2019.05.31
- watch makes requests using Protobuf now (Google native)

0.4.5 - 2019.05.30
- adjusted debounce and throttling times
- introduction to constructing Assistant Requests on watch side

0.4.4 - 2019.05.30
- fixes from 0.4.3
- improved stability

[STRIKE][B]Update 0.4.3[/B]
- using .net reactive framework to handle the problematic cases
- added debounce for button
- added throttling to sensitive method calls
- bugfixes[/STRIKE]
Too unstable, use older version.

0.4.0 - 2019.05.28
-UI draft retouch
-lots of core changes / cleanup
-cosmetic changes

0.3.1 - 2019.05.25
-support volume control

0.3.0 - 2019.05.24
-now using protobuf to talk with phone
-getting mp3's as audio response
-moved most of the response handling logic to watch
-added scroller

0.1.1 - 2019.05.17
-improved auto reconnect / launch android app stability

0.1.0 - 2019.05.11
- code cleanup
- support for external credentials.json file for testers
- improved stability
- auto launch AndroidApp
- auto reconnect

0.0.2 - 2019.05.07
- real time voice recognition text display
- assistant response display
- ability to stop assistant talk with press "Listen" again
- completely reworked internal logic(once again, I hope last time )
- use of new libraries
- changed buffering methods
- changed multithreading libraries

Initial post: 05.05.2019

Downloads

Watch app:
http://apps.samsung.com/gear/appDetail.as?appId=com.cybernetic87.GAssist.Tizen.Wearable

Phone app:
Available on Play Store, the app page will open automatically on Phone after you run the watch app.

Installation instructions

First generate the secrets.json file using tutorial below:
Video tutorial: https://www.youtube.com/watch?v=VfunEUzzFVU&feature=youtu.be
Put it in a folder on your phone. Folder name does not matter. You need to browse to it later when setting up phone app.

Install GAssist.Net app from Galaxy Store. Open Galaxy store and search for Gassist under the apps tab.
Or, got to this link on your phone. https://galaxystore.samsung.com/geardetail/com.cybernetic87.GAssist.Tizen.Wearable

After watch app is installed. Open it. Give it permissions. Watch will say "Companion app is not installed. Check your phone".
The phone will light up and the Google Play Store will open to the Gassist companion app install page. Click install. Click open. Give it permissions and follow the authentication instructions.

FAQ

Q: Will this application be available on other watches than Galaxy Watch?
A: Yes, this application should work on any Samsung watch with Tizen 4.0+ and microphone/speaker.

Q: Will this be a paid app?
A: Yes, but the price shouldn't be more than 2USD. I will consider making it 2 variants Free and Premium.
The app will be free.

Q:Will non speaker watches be supported ?
A: Yes, when I develop the text output.

Q:Can this app do xxxx?
A: The app can talk to Google Assistant SDK Service. I'm not answering for any Google Assistant SDK / Service features related questions. This doesn't depend on me, my app is only a bridge to Google Service. Please ask Google what the Assistant Service is capable of, and why not all features are available. Send query to their support, post on their forums etc.

How to get the logs

You have to have Tizen studio installed. Watch has to be in debug mode.
Immediately after crash / bug connect watch via wifi.
Open Tizen SDK Device Manager.
Wait a while until it reads the logs.
Export logs:

Zip them and attach to post reporting bug.

THANKS!

 

[S3V3N]

Cool

 

[galaxys]

Sounds like a plan! Cheers

 

[burrzoo]

Great idea. I'm pretty sure lots of people want/need this! I'm using a similar type of app for Alexa. It is very, very handy to have.

Sent from my SM-N960U using Tapatalk

 

[Cybernetic87]

Great idea. I'm pretty sure lots of people want/need this! I'm using a similar type of app for Alexa. It is very, very handy to have.

Sent from my SM-N960U using Tapatalk

I've been looking at this Alexa app, and it's very bad... My app even at pre-alpha stage is way more advanced

Doesn't record fixed voice length but recording time is based on voice recognition (recognized text is not changing = stop recording) the same as it works on the original assistant this way it can recognize variable length commands - you can say something short, or veeeeeeryyyy long, as long as you like and it will always know when to stop and send reply.

Also my app is way more responsive - the Alexa app feels very unresponsive to me.

 

[burrzoo]

I've been looking at this Alexa app, and it's very bad... My app even at pre-alpha stage is way more advanced



Doesn't record fixed voice length but recording time is based on voice recognition (recognized text is not changing = stop recording) the same as it works on the original assistant this way it can recognize variable length commands - you can say something short, or veeeeeeryyyy long, as long as you like and it will always know when to stop and send reply.



Also my app is way more responsive - the Alexa app feels very unresponsive to me.

You are right with most of your observations! The thing is, I live in the Alexa world for my lighting system and more & have no other choice. It works for what I need even if not perfect. I use GA on my Note 9 because Bixby is pretty much pathetic.
Maybe after you perfect your GA app for the watch, you can start on an Alexa app. Competition and choices are what makes apps great! I'd be a beta tester for that one and/or even pay $10 - $20 to get your Alexa app. I'm no dev but do understand how many thousands of lines of code can go into apps. Good luck!

Sent from my SM-N960U using Tapatalk

 

[andy242]

Great idea, Google assistant is the only thing that lets the galaxy watch down. Ive been praying for 2 years Samsung would sort Bixby out, its voice recognition is terrible and has so many limitations. Count me in for any testing you need

Sent from my SM-N950F using Tapatalk

 

[mick353]

Happy to be a Beta tester.. I'm a Quality Assurance manager (system tester) for a huge Government organisation.. Happy to help get this project on it's feet mate

 

[TarikVaineTree]

This is awesome! Curious where it is going!

 

[illetyus]

Hello. I am Tizen 4.0.0.2 user from Turkey.
I am an English Language Teacher.
I use Samsung Gear Sport.
I can gladly be your beta tester.

 

[optimous012]

I am Android Developer and QA Engineer here in the states. Would love to beta test for you if needed! If not great work man! Looks really promising

 

[Dixon Butz]

Add me to the test. I have a galaxy watch, many google home devices. And a lot of wifi outlets, wifi switches, wifi garage door openers, thermostats, much more.

 

[Cybernetic87]

Guys,

Whoever wants to participate in beta tests, please send me on priv message the following details:

Watch Model:
Tizen Version:
Phone Model:
Android Version:

I will contact with chosen persons.
For first alpha testing I would need the most experienced ppl with android, a little bit technical knowledge would be cool.

What I would need from you is to send me logs from device (I will tell you exacly how), also I would need to make screenshots from Android and pictures of the app whenever crash / debug message appears and detailed description under what circumstances the error/debug msg appeared.

For example:
"I was saying "Hello google, where is the nearest supermarket" and the app crashed, the listen button was greyed out, was on WiFi + screen from android app + picture of the watch face with error message etc. + watch logs.

Please participate only if you can meet this requirements.

Thanks,

 

[Faspaiso]

Edit: Saw your post. Will you a pm.

---------- Post added at 09:30 PM ---------- Previous post was at 09:25 PM ----------

Would you be able to change language on the GA? Cause my biggest complain about Bixby is that it doesn't understand my language (danish) while Google assistant does.

Thanks for your work and thanks in advance!

 

[Cybernetic87]

Yes, it already works in other languages - for example I use it in Polish

 

[rohan3]

Excellent work mate! pm sent.

 

[talormanda]

Looks great. I would be up for beta testing this.

 

[gaetanolip]

cool! does it work only when connected to the phone or it is a standalone app?

 

[meo]

Some Input for implementation

best way is to use it without mobile:
Some Input from very intressant application:
https://voiceinacan.com -> an Alexa Client on the watch without need mobile
He has very usefull input to implement the solution
https://forum.xda-developers.com/smartwatch/gear-s3/alexa-samsung-galaxy-watch-t3900043
--> https://damian.fyi/2018/12/05/xamarin-tizen-http-2/ !!!

https://twitter.com/DamianMehers
https://www.iotgadgets.com/2019/04/use-xamarin-to-develop-tizen-smartwatch-apps/

 

[Cybernetic87]

Two days full of work and I'm happy to inform that we're on version 0.0.2.

New demo vid: https://youtu.be/qtfn6-p5CQA
(edited video link cause of hotfix, now real time text displays correctly)

New features:
-real time voice recognition text display
-assistant response display
-ability to stop assistant talk with press "Listen" again

Technical changes:
-completely reworked internal logic(once again, I hope last time )
-use of new libraries
-changed buffering methods
-changed multithreading libraries

As for the question: this app will never be standalone on watch.
gRPC is the library used to talk with assistant webservice and this library is not available on Tizen, end of topic.
I won't write my own interface to talk with Google API.