Performed a Factory Reset wipe in TWRP and signed in with a different account. Google account Calendar sync was back. So it must be something with calendar data not being happy with CM12.
Restoring CM11 backup now. Not sure what the calendar sync issue is. All other services and data seemed fine.