Henry James has that effect on a lot of people.

I read him at university and had a hard time getting through the novels. It's only in the last couple of years that he's grown on me.
You're right; so much of this has to do with exposure. My high school English courses were a marvel when I compare them to what kids are assigned today. Then, I took a course in Victorian English literature, so that's where I learned to appreciate many of those novels. I also took a course in the literature of the American south, and I was hooked for life.
Then, there's my lifelong interest in Italian history, and, because of the stories on which I grew up, books about the war.
I was also blessed to live in a neighborhood with a lot of very "arts" oriented people who formed a book club years ago. We started with people's recommendations of their favorites, but then moved on to working from the national book awards lists from the U.S. and the U.K. One book a month, and it starts to add up.

I just listed the ones that immediately came to mind...which reminds me...how could I have forgotten Angle of Repose, Stegner?
Btw, we do read Canadian authors, including the work of Alice Munro, and I admire her, but for whatever reason, her short stories don't "speak to my heart". I did like Margaret Atwood's The Handmaid's Tale and Alias Grace very much. I somehow missed Surfacing, but I'm going to pick it up.
Oh, and I like the "new" Canadians. Ondaatje is on my list, and Mistry's A Fine Balance should have definitely been on it. I loved that book.