The synopsis gets the gist of the story, but as it progresses, more and more women are introduced; (small spoilers?) most become love rivals or bring up memories of the past. I wouldn't call this a harem by any means but there are multiple love conflicts. Side characters play a huge role, as they actively challenge the social norms and morality of the main leads.
What I love is how smoothly the story switches between perspectives and how elegantly new characters are introduced. Sure, you might hate some for their "ulterior" motives or what they did in the past but the way they are portrayed is quite beautiful.
I highly recommend you give the LN or even the manga a shot, once you look past the "taboo" aspects you will see a wonderfully written piece of art.
Edit: After reading thru most of volume 3, some of this "love" drama can be logically frustrating, but it barely detracts from the main plot/duo.
