When my wife and I first got our Captivates her connection was really loose and would fall out. It turned out to be the plug itself, so maybe you can take it back to where you bought it from and ask for a new one.
This is my third Samsung android phone (captivate and nexus s), and it seems to be a common issue. I think its the cable though, as an HTC cable is nice and snug.