Do you need Wifi to use an antenna box?

If you're talking about over-the-air TV programmes - no, you don't need WiFi. You need a TV with antennae input (coax), or external TV tuner box.
 
Solution