Default [Q] accelerometer/compass/gyro drift

While using photosphere I always happen to bump into 2 issues:

-while viewing photospheres in compass mode all spheres are rotated 90 degrees (when "looking" at west it shows north part of sphere

-when doing 360 deg. spheres as the compass drifts I can't "stitch" first photo with last because they overlap too much or too little.
If I would the the photoshere from left to right one "row" then point up and go again from left to right upper row of photos and then go below center from left to right it wouldn't match.

Any ideas what to do?