Goodwill used to be a great site to discover vintage books and vinyl. But lately they seem to be cherry picking the good stuff and sending it to national headquarters for resale. Still, you do find some good stuff--recently an autographed Haruki Murakami novel (if it had the dust jacket, it would have sold for $400+)
My favorite non book / vinyl purchase: a pair of Old Forester glencairn glasses celebrating the 75th anniversary of the repeal of prohibition (both now broken). Can't find a replacement online (except as part of the original whiskey set, selling for $$$$). Had I but known, I would have taken better care of them.