Unless it was an actual protective plastic insert in the port, you likely broke the cover and connector holder. Every digital port has a small door over it that gets pushed in when the cable is inserted, it protects the port when not plugged in and uses the side of the open door against the cable to hold it in. You can see that plastic door in the picture, and it does belong there if that is what you were talking about.