iFixit sells what you're after for $3.95.
Custom-cut adhesive strips for installing iPod Touch 4th Gen (Generation) display assembly. A must-have for any broken, cracked, or shattered screen replacement. Used to attach the display assembly to the rest of the iPod case. Made from high quality 3M d — 20 available at 3.95 each.