Reoccuring headphone jack issue.

My headphone jack on my moto g 2nd gen stopped working unless you pulled it out a little. And it was old so I just bought another and transferred the data from the old one to the new. But now I find the new one has the same issue. Is there some sort of hardware problem perhaps that I somehow transferred from the old to the new by accident, or is this a physical problem. If so, how do I fix it.