The problem is the Realtek Audio Drivers. Windows doesn't have a sound for the event so it supplies the old-school default beep. Truly annoying.
Go to Device Manager>Sound, Video & Game Controllers> and uninstall the Realtek device (choose to delete the drivers as well). Then click "Scan for...