great work Jhinta, installed your Kernel and works like a charm.
Found a few things that are still missing.
I had a few Problems with the touchpad, but was able to fix it with the ubuntu 12.04 mtrack driver. Had to add an InputClass to the xorg.conf though
I replaced the fb.c with the one from the latest Nvidia Kernel. As far as I can tell GLES ist working. Nice thing is ubuntu 12.04 has an nvidia-tegra package.
Wifi works with Networkmanager.
Sound is not working for me with the new Kernel. I'm not sure wether it's the new Kernel Driver or the Ubuntu update. Sound with aplay is still working using lilstevie's Kernel. But pulseaudio makes some pthread_mutex_unlock(...) assertion. So I guess it's both the Ubuntu update and kernel driver.