I found the answer myself, searching for "Terminal" in the Application Dash didn't get me anything, but searching for Clock showed me the core apps there. Clicking on the "Terminal" I could install it (after going back to System and adding my Ubuntu One account).
I thought "core" applications would be in the system by default but only the "system" apps are there after a clean install.
XDA Developers was founded by developers, for developers. It is now a valuable resource for people who want to make the most of their mobile devices, from customizing the look and feel to adding new functionality. Are you a developer?