It was broke
The problem was not the volume/start button. It was the device itself. I thought, it was the battery, at first, then I bought the button. I wasted 20 bucks between the two.
Don't buy Samsung.