Got it, was using wrong commits from bbelos. This is stock kernel w/ bbelos overclock/undervolt, fixed capacitive backlight, and crespo modem support. If someone wants to package it. Just replace boot.img in the .zip from didhiy with this one.
http://marcusant.com/sgtkwol/boot.img
Edit: Huge thanks for the help, about to travel and Nyan hates my phone. Lost over 10% battery while using navigation for half an hour with it plugged into car charger. It was extremely hot. Not knocking Nyan, as it seems to be a good kernel with a lot of users, but it really hates my phone.
Further editing: If you just add the 2 commits for crespo modem here
https://github.com/xboxfanj/android_kernel_samsung_victory/commits/gingerbread/ and compile the kernel, you can just replace the boot.img in the .zip and you can run any kernel with crespo modem.