Trying to access /storage/usbdiskX/ in a terminal though, seems to require root permissions. This may indeed be a problem.
Edit: Hold that. I had stickmount from Play Store installed but thought I wasn't using it. When uninstalling it, mounting USB devices no longer works.
Use stickmount and you should be good.