When trying to get the gummy residue left from price tags, magic marker or pen marks & such off of my cd jewel-cases, I use this stuff...
Works like a charm for that. I might do the trick for you, but I don't know how it will effect vinyl. It's an oil-based product.
_________________
I used to be with it, but then they changed what "it" was. Now what I'm with isn't it, and what's it seems weird and scary to me, and it'll happen to you, too.