You've got me musing about Heidegger's vinyl collection. I'm thinking "Mechanical World" and "Nature's Way" by Spirit, and maybe King Crimson’s “Starless” (which may reveal that I know more about classic rock than about the philosophy of Heidegger). If he had been alive in 2002, he might have appreciated Basinski's "The Disintegration Loops."

BTW, there is a product (I don't have the reference handy) that removes price tags and gummy thrift store labels without harming the record jacket. Worth every penny.