Speaker has damaged RCA terminal.

Your rca jack is missing the ground connection. This is usually a common connection for both channels so you just have to connect the ground of the cable to other channel connector ground. You can wrap some wire around both the cables to do this.