Yes, it is possible. The device on my third line was lost without insurance, so I swapped a SIM card into a AT&T prepaid device as a temporary replacement.
It is definetly possible. It just depends if your phone is compatible with the network. Google your phones specs and compare them with AT&T's supported frequences. I would check with your local AT&T store if you are unsure.