Default Headphone Controls Not Working

I just got the Samsung S4 OEM headphones and they have everything I was looking for: tangle free, decent sound, and 3 button controls (black would be better but meh).

All 3 controls were working, volume up/down and pause/play/skip (double click).

But now it's not working. It will work for a few minutes if I open Jays Headset or Degauss, but then it stops working again in Google Play Music.

Any ideas?