No way to know. Only he controls what contacts are saved or deleted.
Very few people really go through and clear out old addresses, phone numbers, email addresses etc. unless forced to do so for some reason.
My guess would be (based on your concern about it all) that he probably still has your contact saved. Especially if there is some malicious intent or possible harrassment involved.
In that case, go to the authorities.