Default Overly loud minimum bluetooth volume with Sony SBH20

I just got myself a SBH20 today so I can use bluetooth with any earbud. It sounds great but the minimum volume is quite loud (almost the loudest my ears can tolerate).

I searched on google and on here and found a few complaints about high bluetooth volume and most people said KitKat 4.4.1 has addressed the issue (I think my problem isn't exactly the same as described). I am on 4.4.2 already. Same kind of problem on a N7 with 4.4.2. I also tested it on a Nexus S on ICS and HTC One on Jelly Bean. The SBH20 worked fine with those phones since I can control its volume separately from the bluetooth volume of the phone.

Anyone here owns a SBH20? Do you have the same problem? If so, how are you getting around it?