It's not a problem, it's just designed like this.
If I'm not wrong some roms have a "always on led" behavior, but it's on the kernel side too...
For example from ElemantalX kernel OP:
So maybe with a third party app you'll need that option must be implemented too in the rom and/or kernel?
I'm not sure...
What app do you use?