And from my experience, you also need to do it while the recovery drive is inserted into the USB port. I was expecting to see a prompt asking me to insert the recovery drive, but that prompt never came.
Finally, after plugging in the recovery drive, holding down the Volume Down key and pressing...