You started with what many people (including me) consider their best album.

If you have the time, I'd recommend following them chronologically, starting with Face to Face (but skipping some of the outtakes).

* Face to Face

* Something Else

* Village Green (you've already discovered this gem)

* Arthur

* Lola versus Powerman

* Muswell Hillbillies

From here, it gets more problematic, though after listening to all the above, you will probably be a dedicated Kinks follower. The 80's Kinks don't do well with the critics, though they've had some of their most popular hits from that period. The following 3 get high marks on AllMusic, but I'm biased, so I like anything they've done.

* The Kink Kronikles

* The Great Lost Kinks Album

* Misfits

It may take you a year or more to voyage through everything asterisked here, but (I'm biased) the journey will be rewarding.

Even on albums that no one (except the diehard fans) seems to like, there are wonderful songs. Here's an example, from their soundtrack for the movie Percy: "God's Children." The movie is a smarmy British comedy about a penis transplant, but Ray Davies undercut the sleaze with a hymn dedicated to the natural state of things. This song can make the most hardened listener shed a tear or two. https://youtu.be/U9mXGjjsVko

Have a happy voyage.