The problem with system apps and services is that we should only mess with them if we have a way to flash a firmware back on.
I would not risk a brick or mess around for hours through ADB.
The reason is quite simple:
1. The GO is not a licensed Google device, so we would need to use a hacked playstore setup to overcome the nagging unauthorised device crap.
2. The system is based more on the Amazon TV stick, which makes things a bit complicated.
3. The play services and framework need to be modified to work with a VR setup.
A simple TV version will fail as we can't really match the required specifications.
At least not without rsking access to Oculus stuff.
4. The interest for developers or rom cooks is quite limited.