These are great points. I lost my turntable and then my records several decades ago, and recently got back into vinyl thanks to thrift store purchases and a thrift store turntable, which alas my dog destroyed. I've purchased a reconditioned Fluance but haven't set it up yet--as you say, convenience is a major factor, not to mention space and component matching.
Here's another argument for vinyl: there are many albums from the 50's-80's that aren't on cd/streaming (in fact, I just read about a Pink Floyd track that's only available on 8-track!!!). Searching for old vinyl makes record buying an adventure, just as it was for me in the 1960's.
Happy listening.