I got some more information about my problem.
http://prntscr.com/d6y2jr
when ever I put the video to 1440p or higher, the buffer health almost halves, and the connection speed increases slightly.
At some point, the dropped frames cap. Like, it gets stuck at 0/1635