I've found that MP3Tag is the best program of all for tagging audio. It conforms flawlessly to the ID3v1, ID3v2.3, ID3v2.4 tagging standards and any other format that you like such as Vorbis Comments.
It's very quick at batch tag processing also. I've imported ~20,000 songs on occasion in order to add comments or remove unnecessary fields from the files. Never crashes.
BTW, the MP3Tag equivalent on Linux is Puddletag which has very much the same layout and features.
foobar2000 is the best audio player. Once you install the Columns UI plugin and a few other plugins, it becomes a very powerful program. I know that in the past some of its tagging capabilities were a bit hit or miss, but with some of the newer releases many of the problems have been ironed out.
It's expandability is very impressive. If it can't immediately play an obscure audio format, there's sure to be a plugin that will.