Okay, so I tried using another RCA/red and white cable, and that made both speakers work. I'd say that the old cable must've been broken, but the thing is that it worked perfectly with my Pyle receiver, so I don't really understand that...
By the way, I did try switching the cables around...