No GMK is right, flashing from ROM manager isn't permanent (i.e., its not actually on the recovery partition)
Notice when you enter the recovery, it looks like its flashing something...
I verified this when I installed CM6 nightly. I had the 184.108.40.206 'flashed', but after I updated to CM6 it was suddenly back to 220.127.116.11
Samsung Galaxy Nexus
Rogers Magic on AT&T
HTC Touch HD