I would use extreme caution with a Y-adapter in such a scenario. You have the potential of feeding two audio signals in simultaneously.
Depending on the outputs of your 2 audio cards, then you should patch into an audio switch hub. If you have SPDIF or TOSLINK then you could find the appropriate switch box, and get the best audio reproduction.