It's because the device has to wake from deep sleep and load stuff. If your lock screen is off, it is having to load your home screen. You may have more on your home screen than what is on the lock screen. I always keep a pin based lock on all my devices. That way it doesn't have to load too much when coming from deep sleep.
Sent from my SAMSUNG-SM-N900A using XDA Premium 4 mobile app
Lost in a paper bag again...