The USB port on your TV will not work as an audio output. The USB port on your stereo may be able to play music from a drive but isn't an audio input either.
Your TV should have an audio output (usually optical digital) so you may need a digital to analog converter to connect it to your stereo unless it has a headphone jack (or analog audio outputs). Check the TV manual on how to use the audio out. You may have to turn it on, turn the TV speakers off, and change the audio output type in the TV menu.