Using the Tv's built in speed test, without any wireless security I get about 2,000kb/s. When I add security be it WEP, WPA, WPA2 etc. The download rate drops to below 100, and makes things like netflix and pandora unusable. The router is running 802.11n like the tv recommends.
I got it mostly fixed, in case anyone else ever has the issue here is how.
Wireless is WPA2 Personal, Encryption is AES.
Network mode is N only, radio band is standard 20 MHz. Standard channel is 5 - 2.432GHZ.
I live out in the country, so my router is the only one around, so I have no idea why changing the channels helps but it did. The tv still downloads faster when encrypted, but now with those settings it gets about 4,000kb/s encrypted, and almost 8,000kb/s when not.
Edit: I cannot see how to mark this thread as solved. So if a mod would mark it, or if someone could point out how, that would be great.