I'm coming from a N4 as well.
It really depends what you use your phone for and how big a phone you're willing to carry around.
I use my phone mainly for calls, txt, and email. I'll occasionally use it for games, web browsing, and youtube vids, so for me, I'm really not sacrificing much going...