In 3 years, my 00 GLX sedan never had any wear problems like this.
However, even those who don't use any lotions, cleaning fluids, etc may still occasionally have this issue...my 03 W8's sunroof panel and map light buttons suffered a bit of bubbling and peeling after about 4 years - it was replaced under warranty with a new panel and buttons. I never used any lotions or cleaning fluids...and never had problems with many more regularly used buttons in the car, so I took it as a fluke.
Since many of us have had Passats for 3 years, 4 years, or longer, without having buttons suffer such problems, it would have to be a bad batch, unlucky random chance, or some kind of exterior influence like cleaning fluids or lotions. I definitely hope my B6 doesn't suffer such peeling or wear.