This is going to be hard to get the various libs in arm format. Especially the libnfc and other nfc specific libs. But this is only needed if you really want a certain program to run, but you can always do some heavy work with a read reader on the pc and make an app on the phone to do other stuff not needing such programs.
Yeah, I found that out the hard way, it's all fun and games until the point where something isn't ARM compatible, and the sourcecode won't compile as well.
Besides, I really doubt that there is a NFC driver out there for ARM that isn't limited (ie: no writing/emulating) by Google/Android.
Although I was amazed how far I came, nearly all programs except the USB driver and some other dependicy.
Did anyone ever ran Linux from the core of the phone? Not booting an ISO within Android, but really install Linux on the phone?