You should only remove the disk if it isn't the one with the system on it. That protects any data on that disk which you want to keep in a safe place. After doing that, if the system fails to boot, it should present you with some repair options.
Which version of Windows was it running?