Thinking back, having huge harem is boring.
Due to numbers of characters, the girls usually would not be given much personality and end up being more or less generic, with one another.
The fewer characters the better, therefore we can enjoy more in-depth personality, their flavors, quirks etc.