I did a quick search, and reproducing album covers for reviews does seem like fair use.

https://psu.libanswers.com/faq/336502

However, check this article out. It looks like Taylor Swift is TRADEMARKING certain phrases from her lyrics. No fair use leeway there.

https://www.unifiedmanufacturing.com/blog/album-artwork-copyright-infringement-cases-for-album-artwork/