Unless the card is set up to be "Internal" storage, rather than the standard "External" storage, it should be fine to put things on it and take them off of it.
However, if you set it up to be "Internal" storage, so that you can run apps from it, then you would have to move all those apps back to the phone, or completely uninstall them, and then have the phone convert the card back to "External" storage.