I've been having this problem lately, and I couldn't find the source of it, or solutions anywhere.
When I open up YouTube (can't confirm the issue appearing elsewhere), the first video I watch goes on smoothly. If I open up another one, then the video stops, starts buffering for a few seconds...