It's all Chinese to me

A while ago I ripped a CD of Chinese music that I bought at Beijing Airport, so it was a pukka copy and not a pirate version (I hope). It wasn't much of a surprise to see the the genre, tracks, artists, etc., displayed in Chinese characters so I carried on and ripped the CD into my player. Unfortunately, every CD I now try to rip comes up in Chinese characters, even though my player's language is selected to English/Latin. I've since wiped the Chinese tracks from both my PC and player but any CD I try to rip is still displayed in Chinese.
Does anyone know how to get my player back to speaking English?