I was never a huge fan either. My "snapshots" of Yes are clumped in my mind with "Fragile" and "The Yes Album" (with Steve Howe) in one compartment, and "90125" with Trevor Rabin (had to look that up) in the other compartment. Their epic concept albums with LP side-long songs flew right over my head.
I was into Priest, Maiden, Sabbath, Zeppelin, ACDC, etc. I didn't really enjoy prog-rock until Rush. But in spite of that, I really enjoyed the aforementioned earlier Yes albums - the latter, not so much. I thought "Leave it" and "Owner of a Lonely Heart" off 90125 were... meh... interesting experimentation with massive multi-tracked vocals, and a unique take on the synthesized pop music of the 80s, but that's about it.
So again, I have to profess my ignorance of rock history. I didn't know there was a Yes guitarist before Steve Howe. But Peter Banks, RIP.