I did a factory reset and installed ~10 of my most used apps instead of restoring all apps and it's been sleeping fine now, no wakelocks
I also turned off WiFi and Bluetooth scanning, location services are on battery saving, and Google location reporting is off