You have to root the device if you don't want to hook USB cable to pc to start it, then you can just press start/stop button. For non rooted device, you hook the phone to the pc, press a button to start the server, then disconnect the phone from the pc. You can remote to the phone afterwards as long as you don't power it off. In other words, once server started, no need at all to connect the phone to the pc.
My phone is not rooted, and seldom powers off, so I do this perhaps once a month, then you disconnect the phone from pc, which is not bad at all, just like a user would use USB cable to do data transfer. I don't know why it defeats the purpose, a few thousands of users are happy with it.