Default Recovery Lagging

Has anyone had the issue of the recovery lagging really bad? I was on CWM recovery and I would select something and it took about a second or two for it to do what I wanted it to do. I just installed TWRP and it does the same thing. I never had this problem on my SIII but I do on my SIV. Its just annoying. I can live with it but I'm just trying to figure out if anyone else has been experiencing the same issue as me.