Default Pop up notification aren't dismissed when replied to in full app Cyanogenmod

I'm running CM 11 and I have pop up notifications for sms enabled. I have a 3rd party lockscreen app because I want to see the text when my phone is locked. But when I launch it from the lock screen to reply the pop up notification isn't dismissed