This is a common 'issue'
I work in the technical support field, and, unless you are both running Gigabit, sharing the same router, stars are aligned, it will suck royally.
Unfortunately, the only way to 'cure' this is not ideal.
Example: For use on an actual PC, there is an option to disable background images/pictures, as that would really eat up data bandwidth and transfer speed and cause distortion.
So, that being said, we love these devices for just those features...the 'pretty stuff'
Team Viewer is an awesome tool, but, IMHO, not ideal for these devices, unless for basic troubleshooting.