If you are connecting to a single jack on the computer, are you sure it isn't a headset only one? It must be input/output for a headset with mic to work in it. And, sadly, many of those don't even work correctly.
A way around this is to get a 3.5mm to USB adapter and connect through there. Should work just fine.