Default Anyone else have this issue where the CPU will randomly change frequency?

I've had this issue on Mahdi ROM which is what I'm on right now, but also every other ROM and every kernel that I've tried except for ElementalX. Basically, the kernel will change it's max frequency to 1.19 GHz usually, and soemtimes 1.6 GHz or 1.9GHz and you can't change it back until you flash a different kernel. Rebooting doesn't help, and changing it kernel tuner only helps temporarily. Every other kernel app only changes CPU0 for some reason not sure if that's just be or what. It's a very strange problem, and I have not gotten any help or suggestions so far, so if anyone knows how to help, that would be great. Again, this has happened on every single ROM I've tried, with every kernel, except ElementalX (and I think Trinity but I didn't use it long enough to be sure).

Sent from my Nexus 5 using XDA Premium 4 mobile app
Current as of 8/23/14 @ 12:19 AM EST
Phone: Nexus 5
Carrier: AT&T
ROM: Mahdi
Kernel: ElementalX
Android version: KitKat 4.4.4

Old Phones
Some Motorola flip phone - retired
LG Shine - battery died
Samsung Solstice - retired
HTC Evita - died
HTC Evita (replacement) - retired

ROM: ViperXL
ROM Version: 4.2.0
Kernel: ElementalX 8.3.2
Android version: Jellybean 4.2.2
Radio: 3.18