Yes, it is that easy. You can install zips for the newest versions of CWM, TWRP, or PHILZ from your current recovery.
Of course you may not be able to restore your old backups. But you can flash back to the old recovery to restore these too.
Most people are changing to different recoveries because of recent changes in Android that makes it trickier to flash the newer Roms.
I personally switched from TWRP to Philz. It is CWM based, but will also restore TWRP backups. Phil is very receptive to questions and had made his recovery available on a lot of devices, more being added every day.