[app] Mr. Mouse (beta) - Mouse control via device camera

Search This thread

MM32

Senior Member
Feb 23, 2010
59
15
Mr. Mouse (Beta) UPDATED [20/12/2012]

I have made some updates to the Mr Mouse Application. I have been getting a lot of complaints that it was not working on 4.0+ devices so I have fixed these issues.

I had to rework the code to be comparable with the new OpenCV lib, so I was just able to get it working again so that those that are really anxious to try it,can satisfy this craving now. I am hoping to find some time to improve the camera algorithm by using the orientation sensors to help with the motion estimates. However I likely will not have time to finish this until next summer. Hopefully I will be able to at least get the application working better than it is now, with Bluetooth working and proper error messages soon.

Merry Christmas!


Mr Mouse works with your windows computer as a Computer Mouse and Keyboard.

The Computer Mouse can be used like a touch pad or a motion controller (beta) and connects to your computer over your local Wi-Fi network or via Bluetooth connection. (Server Required see bottom).
The Motion controller uses images taken from your devices rear facing camera to determine its motion, translating this information into real time pointer movements on your monitor.

Features
Bluetooth / Wi-Fi Connection
Touch Pad controlled Mouse Pointer
Motion Controlled Mouse Pointer
Two Finger Page Scroll
Pinch To Zoom
Keyboard input

Coming soon
Presentation controls (controls added but not yet supported by the server application)
... your suggestions.

img.php


This is a beta release of this app so expect bugs.

Mac Hack install guide (translated):
http://translate.googleusercontent....-wine/&usg=ALkJrhhp3KTxvmSl26vSyEJ8VqROepU-pw

Please let me know what you think.

If you are having trouble understanding this app please see the post from addictive tips on it's use.

http://www.addictivetips.com/mobile...oid-device-into-a-motion-tracking-wifi-mouse/

or Watch this YouTube Video
http://www.youtube.com/watch?v=KaTFHjN3AOw

Android market link
https://market.android.com/details?id=com.theMisterGuy
server
https://sourceforge.net/projects/mrmouseserver/files/
or
https://rapidshare.com/files/3232960506/mr-mouse-server-1.2.msi
V1.7
ARM support
-Removed ARM v7a with NEON
*Fixed missing lib that was effecting devices like the HTC Wildfire.
Camera Mouse
*Vast improvement in performance
*Fixed force closing (again)
*Removed camera view
*Added indicator light that shows the status of the camera mouse when in use.
Bluetooth Connection
*Error messages now helpful
1.6
ARM support
+ARM v7a with NEON
Camera Mouse
*Improved performance
*Fixed force closing
*Simplified camera view
*Lowered power consumption

1.55
Minimum API
*Reverted to minimum API of 7
Access Permissions
*Removed the need for "Write to external storage"
Language Support
+German (Special thanks to Jonathan A.)
+Spanish
Camera Mouse
*Smoothed starting transition
Preferences
*Fixed reported bug when switching between Bluetooth and Wi-Fi
UI
*Added controls for presentations (not yet supported by the server)

**Various bug fixes
1.5
**New Server**
Connections
*Bluetooth support
*Improved establishing Wi-Fi link
Scroll
*Improved sensitivity of the page scroll
keyboard
*Improved layout *Thanks dermann @ XDA
*Fixed show/hide keyboard bug in options menu

1.30
**New Server**
Touch Mouse
*Multi-Touch support, pinch to zoom and two finger scroll
*Double tap, double tap and move
*Improved sensitivity settings
*Fixed bug with scroll sensitivity settings
UI Elements
*New keyboard

1.2
Recompiled with OpenCV 2.3
Added support for pre ARM 7 devices, *not confirmed working
Camera Mouse
Optimizations

Wifi
Optimizations for sending data
Improved connection initialization

Server
Various bug fixes
Mouse Movement algorithm reworked
Optimizations for receiving data

1.01
Camera Mouse mode
Optimizations
Various bug fixes

WiFi connection
Improved connection stability
Various bug fixes

Settings
Minor bug fix

ONLY 2.2.2, 2.3.3, 2.3.4, 3.0.1 are confirmed working OS versions to support the native camera libs that are included in this project

Confirmed Supported Devices List:
HTC Nexus One
HTC Sensation 4G
HTC Desire HD
HTC Desire HD 2
HTC EVO
Samsung Galaxy S
Samsung Nexus S
Sony Xperia Arc
 
Last edited:

JayBeezy802

Senior Member
Oct 24, 2010
105
12
If you don't mind me asking, why use a devices camera, when you have access to the gyroscope and accelerometers? Actually with that said, I find myself horribly disappointed by Gmote, so I wish you luck, Android needs something comparable to MobileAirMouse on iOS.
 

MM32

Senior Member
Feb 23, 2010
59
15
Feedback?

I see a few people have tried my app, but I have not got any feedback. Anyone have any feedback for me at all?
 

MM32

Senior Member
Feb 23, 2010
59
15
Sorry it is only built for phones with ARM V7. I will be making a version for older CPUs once most of the debugging is finished.
 

b0dge

Senior Member
Oct 23, 2009
177
5
I gave it a go.

The touchpad seems quite laggy and inaccurate compared to Gmote, and the camera beta just closes the app on my phone after about a second of movement.

Phone: N1 CM7 Nightly #125
PC: AMD V140, 2Gb RAM, Win7

I like the idea, but the implentation needs improvement IMO. I'll give it another go if there are any updates, especially if the accelerometer and gyro is brought in...

Good luck! :)
 

MM32

Senior Member
Feb 23, 2010
59
15
I gave it a go.

The touchpad seems quite laggy and inaccurate compared to Gmote, and the camera beta just closes the app on my phone after about a second of movement.

Phone: N1 CM7 Nightly #125
PC: AMD V140, 2Gb RAM, Win7

I like the idea, but the implentation needs improvement IMO. I'll give it another go if there are any updates, especially if the accelerometer and gyro is brought in...

Good luck! :)



The touch pad issues are in the server. this will be resolved when I update the server.

The app was developed with an N1 stock phone so not sure why it is bugging out, can you send the error log, or does it not give the option? also was this with version 1.0 or 1.01?

accelerometer and gyro would be much easier to implement than the camera stuff. you are the second to suggest this out of 3 responses. I guess i'll take the hint expect a new server and update to the app to add acc and gyro soon.
 

b0dge

Senior Member
Oct 23, 2009
177
5
The touch pad issues are in the server. this will be resolved when I update the server.

The app was developed with an N1 stock phone so not sure why it is bugging out, can you send the error log, or does it not give the option? also was this with version 1.0 or 1.01?

accelerometer and gyro would be much easier to implement than the camera stuff. you are the second to suggest this out of 3 responses. I guess i'll take the hint expect a new server and update to the app to add acc and gyro soon.

I don't get the FC message when it crashes. It just closes back to my homescreen. Sorry...

I could logcat it if that would help?
 

b0dge

Senior Member
Oct 23, 2009
177
5
I grabbed the logcat anyway:

Code:
I/DEBUG   ( 4220): pid: 4242, tid: 4251  >>> com.theMisterGuy <<<
I/DEBUG   ( 4220):          #03  pc 00136b8e  /data/data/com.theMisterGuy/lib/libcvcamera.so (_ZN2cv8fastFreeEPv)
I/DEBUG   ( 4220):          #04  pc 00136b96  /data/data/com.theMisterGuy/lib/libcvcamera.so (cvFree_)
E/InputDispatcher(  265): channel '40b90d98 com.theMisterGuy/com.theMisterGuy.main (server)' ~ Consumer closed input channel or an error occurred.  events=0x8
E/InputDispatcher(  265): channel '40b90d98 com.theMisterGuy/com.theMisterGuy.main (server)' ~ Channel is unrecoverably broken and will be disposed!

Logcat filtered by: mister

Hope that helps... :)
 

MM32

Senior Member
Feb 23, 2010
59
15
I grabbed the logcat anyway:

Code:
I/DEBUG   ( 4220): pid: 4242, tid: 4251  >>> com.theMisterGuy <<<
I/DEBUG   ( 4220):          #03  pc 00136b8e  /data/data/com.theMisterGuy/lib/libcvcamera.so (_ZN2cv8fastFreeEPv)
I/DEBUG   ( 4220):          #04  pc 00136b96  /data/data/com.theMisterGuy/lib/libcvcamera.so (cvFree_)
E/InputDispatcher(  265): channel '40b90d98 com.theMisterGuy/com.theMisterGuy.main (server)' ~ Consumer closed input channel or an error occurred.  events=0x8
E/InputDispatcher(  265): channel '40b90d98 com.theMisterGuy/com.theMisterGuy.main (server)' ~ Channel is unrecoverably broken and will be disposed!

Logcat filtered by: mister

Hope that helps... :)

Thanks, its a problem with the native code. so the debug info is more or less useless.

Can you confirm if you are working with the 1.01 version?
 

ballubas

Senior Member
Jan 19, 2010
399
18
malmö
I'm gonna download it, but I'm away all day tomorrow so prob Tuesday by the time I can try it out and now, finally its bedtime:)

Sent from my X10 TripNMiUI-IRIS using XDA App
 

trailblazer101

Senior Member
Dec 17, 2010
926
782
Pennsylvania
Well, the souchpad mouse controls are good, i guess...

And for me the the beta video movements actually work... Not well on my Samsung Continuum, but still, haha.. It likes to jump around alot though :|

Thanks for everything mr. developer! :D
 

MM32

Senior Member
Feb 23, 2010
59
15
Thanks for the feedback.

I hope to release a new server today and updated app to deal with the lag issues.

The camera stuff is very much a work in progress.
 

MM32

Senior Member
Feb 23, 2010
59
15
Updated Server and App

I have updated the server and Mr Mouse App on the android market, should be hitting your devices soon.

The link to the server is posted on the android market Mr. Mouse page in the description.


See the first post for more infromation.
 

Top Liked Posts

  • There are no posts matching your filters.
  • 9
    Mr. Mouse (Beta) UPDATED [20/12/2012]

    I have made some updates to the Mr Mouse Application. I have been getting a lot of complaints that it was not working on 4.0+ devices so I have fixed these issues.

    I had to rework the code to be comparable with the new OpenCV lib, so I was just able to get it working again so that those that are really anxious to try it,can satisfy this craving now. I am hoping to find some time to improve the camera algorithm by using the orientation sensors to help with the motion estimates. However I likely will not have time to finish this until next summer. Hopefully I will be able to at least get the application working better than it is now, with Bluetooth working and proper error messages soon.

    Merry Christmas!


    Mr Mouse works with your windows computer as a Computer Mouse and Keyboard.

    The Computer Mouse can be used like a touch pad or a motion controller (beta) and connects to your computer over your local Wi-Fi network or via Bluetooth connection. (Server Required see bottom).
    The Motion controller uses images taken from your devices rear facing camera to determine its motion, translating this information into real time pointer movements on your monitor.

    Features
    Bluetooth / Wi-Fi Connection
    Touch Pad controlled Mouse Pointer
    Motion Controlled Mouse Pointer
    Two Finger Page Scroll
    Pinch To Zoom
    Keyboard input

    Coming soon
    Presentation controls (controls added but not yet supported by the server application)
    ... your suggestions.

    img.php


    This is a beta release of this app so expect bugs.

    Mac Hack install guide (translated):
    http://translate.googleusercontent....-wine/&usg=ALkJrhhp3KTxvmSl26vSyEJ8VqROepU-pw

    Please let me know what you think.

    If you are having trouble understanding this app please see the post from addictive tips on it's use.

    http://www.addictivetips.com/mobile...oid-device-into-a-motion-tracking-wifi-mouse/

    or Watch this YouTube Video
    http://www.youtube.com/watch?v=KaTFHjN3AOw

    Android market link
    https://market.android.com/details?id=com.theMisterGuy
    server
    https://sourceforge.net/projects/mrmouseserver/files/
    or
    https://rapidshare.com/files/3232960506/mr-mouse-server-1.2.msi
    V1.7
    ARM support
    -Removed ARM v7a with NEON
    *Fixed missing lib that was effecting devices like the HTC Wildfire.
    Camera Mouse
    *Vast improvement in performance
    *Fixed force closing (again)
    *Removed camera view
    *Added indicator light that shows the status of the camera mouse when in use.
    Bluetooth Connection
    *Error messages now helpful
    1.6
    ARM support
    +ARM v7a with NEON
    Camera Mouse
    *Improved performance
    *Fixed force closing
    *Simplified camera view
    *Lowered power consumption

    1.55
    Minimum API
    *Reverted to minimum API of 7
    Access Permissions
    *Removed the need for "Write to external storage"
    Language Support
    +German (Special thanks to Jonathan A.)
    +Spanish
    Camera Mouse
    *Smoothed starting transition
    Preferences
    *Fixed reported bug when switching between Bluetooth and Wi-Fi
    UI
    *Added controls for presentations (not yet supported by the server)

    **Various bug fixes
    1.5
    **New Server**
    Connections
    *Bluetooth support
    *Improved establishing Wi-Fi link
    Scroll
    *Improved sensitivity of the page scroll
    keyboard
    *Improved layout *Thanks dermann @ XDA
    *Fixed show/hide keyboard bug in options menu

    1.30
    **New Server**
    Touch Mouse
    *Multi-Touch support, pinch to zoom and two finger scroll
    *Double tap, double tap and move
    *Improved sensitivity settings
    *Fixed bug with scroll sensitivity settings
    UI Elements
    *New keyboard

    1.2
    Recompiled with OpenCV 2.3
    Added support for pre ARM 7 devices, *not confirmed working
    Camera Mouse
    Optimizations

    Wifi
    Optimizations for sending data
    Improved connection initialization

    Server
    Various bug fixes
    Mouse Movement algorithm reworked
    Optimizations for receiving data

    1.01
    Camera Mouse mode
    Optimizations
    Various bug fixes

    WiFi connection
    Improved connection stability
    Various bug fixes

    Settings
    Minor bug fix

    ONLY 2.2.2, 2.3.3, 2.3.4, 3.0.1 are confirmed working OS versions to support the native camera libs that are included in this project

    Confirmed Supported Devices List:
    HTC Nexus One
    HTC Sensation 4G
    HTC Desire HD
    HTC Desire HD 2
    HTC EVO
    Samsung Galaxy S
    Samsung Nexus S
    Sony Xperia Arc
    1
    http://market.android.com/details?id=com.theMisterGuy

    /edit: Removed mirror, was outdated.

    Sent from my MIUI SCH-i500
    1
    The quick answer would be that its been done way to many times.
    1
    On my sensation it works well excluding the delay. I think that this is the most amazing concept with some tweaks I think this app will do GREAT!!!
    1
    Would it be possible to make it available in france?

    Now available in France