Why does my mouse stay on when the switch is off?

My Magic Mouse 2 will sometimes stay off even when I've switched it off. It will still move the cursor on my Mac and is obviously still connected to Bluetooth. It doesn't look like ifixit offers a replacement switch. I suppose I'll open it up and clean it, but any advice would be helpful.