Default [Q] Nexus 4 won't close fully

I just took apart my Nexus 4 to replace the screen, and I put everything back together, everything's functioning, but the corner with the speaker won't close fully. I've taken the speaker off and it closes perfectly. Any ideas?