Default Not the normal headphone jack issues...

I'm having trouble with my headphone jack. Audio only comes out if I start the sound on the speaker and then plug in. If I start with the headphones in I get nothing. Its odd. Running the new AOKP. Has been an issue since before that though. Not the usual static or tight jack problem.