The 'All New' HTC One doesn't look as nice as the old one, in my opinion. The original One looked classy, this one just looks kinda regular. Also, the specs really aren't better than even the Note 3, let alone the upcoming Note 4.
As for the S5 (and the One), I don't think I could ever go back to a phone that small. My last phone was the original Note, and now with the Note 3, i've kind of settled into jolly green giant territory and will never leave.
If The next Nexus device were at least 5.5", I might be tempted to switch, but i'm not sure. Probably not gonna happen though.