I would keep the fuse in there. You never know when these cheap electronics will crap out and could potentially start a fire. I would make sure your connections are secure. To me it sounds like loose worrying or a bad unit. I used one of those in girlfriends car, works great-I put a switch in there to cut power if not being used.