"Sticky" hold button. Screen flashes on and off of hold

My iPod has been flashing on and off of hold. I'm pretty sure it's not doing it completely on its own, but instead has something to do with being touched or moved. Has anyone else ever had this problem? Could it be dust? Should I open it up and try to clean around the button?