What speakers did you use exactly, and what splitter did you use? Using the splitter can weaken the signal. If you move the connections around do the working two speakers change or do the same two play no matter what?
Are you saying you are only getting the left or right audio playing, so speakers on the other side don't work at all?