Repair for earpiece on Evolve

A couple of years ago, the earpiece from my Evolve snapped off its mount. To fix it, I used superglue to re-attach, but it didn't hold.

I re-glued it, and then used silicone putty (Sugru) to wrap around the outside. That worked, but now the boom mike can't rotate around fully. This means that I can't switch sides on my one-ear because the hardened silicone is in the way.

This was a little annoying (and looks gross), but it allowed me to repair my otherwise functional headset that was outside of warranty. Now, however, the ear pad is torn and I'm about to replace that, and I figured it might be a good time to further repair my previous repair.

Worried about cutting the silicone back, because it might cause the ear piece to detach again. Does anyone have another idea?