Bump! I have this same issue. I thought it was my video recording choppy, but now that I checked on another device I see it's a playback problem. I'm on 5.1.1 T-Mobile Motorola phone.
Based on no evidence whatsoever, I am going to go with my hunch and try turning off the ambient display. I'll let you know if that changes anything.