I am using stock rom (gingerbread) at the moment and experience none of the lag you refer to. I also tried some of the ics roms and also no lag.
The only time my phone 'hesitates' is sometimes when I unlock it as it switches from widget locker to lock screen. Now as it is a 3rd party app doing it, I can hardly blame the note. I love my note and even got rid of my galaxy nexus and asus tf101 when i got the note.
Sent from my GT-N7000 using xda premium
Don't be shy to hit that 'Thanks' button
Samsung Galaxy S5 G900F - Stock 4.4.2
Samsung Galaxy Camera GC110 - Stock 4.1
ASUS Transformer Book T100 - Win8.1 Pro
Retired / Sold -
Galaxy Note 3 | Nexus 5 | Nexus 4 | Lumia 925 | Galaxy S3 | HTC Desire | HTC Desire HD | Galaxy S2 | Galaxy Nexus
Galaxy Note 10.1 (2014 Edition) | Nexus 7 (2013) | Nexus 7 (2012) | Galaxy Note | Galaxy Tab | Archos 80 G9 | Asus Transformer | Galaxy Note 10.1 GT-N8000