Optibay installation - super driver connector strip

When trying to remove the superdrive for optibay replacement the connector which connects to superdrive had a small rubber like thing. when lifting the connector the one mentioned in the picture came out rubber piecesticked with the motherboard and it did not came out with the connector. will it be a problem?....i mean the rubber thing stayed in the motherboard. after replacing with optibay i putback the things and it works fine. when next time if have to remove the optibay do i have to be careful that rubber thing should not stay on motherboard. please let me know. thanks