Some of the apps (and services associated) are constantly running in the background, which has some effect on performance and also battery life. And they are also taking up our precious RAM.
Right now I'm pretty fond of S Memo but since I'm a very fast adapter, I think I could get along just nicely with apps like colornote/Keep