If you're on completely stock firmware and have wiped, you should experience absolutely no problems at all.
Are you rooted? Overclocking? Do you have a different kernel? Restoring your app data? Installing suspicious files?
If so, try keeping a completely stock ROM for a while.
Android devices owned: Samsung Galaxy S GT-I9000, 8GB, Samsung Galaxy S3 GT-I9300, 16GB (Pebble Blue), Nexus 7 (2013), 32GB