It is my understanding that you turn off VoiceOver by disabling theoption in iTunes and then re-sync the iPod.
and here is some more good stuff from Apple
To turn off VoiceOver on iPod nano using VoiceOver gestures
1. Swipe right or left with two fingers until you see or hear Settings.
2. Double-tap to open Settings.
3. Move your finger up or down the screen until you see or hear General, then double- tap.
4. Move your finger up or down the screen until you see or hear Accessibility, then double-tap.
5. Move your finger up or down the screen until you see or hear VoiceOver, then double-tap. You'll hear "VoiceOver off" to confirm the setting. Now you can use standard gestures to control iPod nano.
http://support.apple.com/kb/HT4317 Good Luck and let us know if it helped
This has been a wide spread problem. Apple is very well aware of it even though they may not offer this information to you. I have had 2 ipods with the same problem. Many Many folks have documented this problem and it is all over the internet. Unfortunately, I have had to move away from the Apple ipod. Bummer for Apple. Very frustrated.