Meaning that you use QoS to give your computer priority over the other network devices - correct?
Is your ethernet cable directly between router and your computer? No wall outlets or switches involved? Try another known working ethernet cable - Cat 5e.
Verify that your computer's wired ethernet adapter is correctly configured to match your router. Try manually matching the configuration versus "auto negotiate". Duplex and speed for example. If "manual", try auto.
Use Task Manager to observe other apps, processes, and services running on your computer. May be some program running in the background and trying to phone home, do some backup, or maintenance of some sort. May be consuming network related resources but grabbing...