If your TV has an AV input you should be able to use the the VCR/DVD for playback. You won't be able to record since the TV doesn't have a video output. Check the TV manual on how to configure the AV input. You may have to set it to composite rather than component video.
If the TV doesn't have an AV input then you will need an AV to HDMI converter.