I know exactly what you mean, I was thinking if we can have so many monitors hooked up to the computer why can't we have multiple audio devices. There might be a solution but I don't know it. The reason it needs to be hooked up is probably because its wireless and needs power. The only other option I can think of is get an adapter that is also usb powered like this
3.5mm connection and usb power connection > usb dongle