You might look at musicians who wrote / published poetry distinct from their musical lyrics.

Two examples: Lou Reed used to publish poems in Fusion Magazine in the 70's, and there's a posthumous edition of some of his early poems. John Cale published some poems in Aspen Magazine: https://werksman.home.xs4all.nl/cale/text/aspen_poems.html

(I used to have copies of Fusion and Aspen, but alas don't anymore.)