Haven't experienced many, but as an incest fan it annoyed me a bit in Lust Theory as it didn't commit to the relationships and took me out of the story. That said, it was high quality voice acting and it would've been amazing if they actual said "brother" and "sister" etc instead of skipping words
It can be SO GOOD when it's done right. Snow Daze is fully voiced and that's one of its biggest selling points. Love Sex and Second Base has this mechanic, but it's only partially implemented, and swings between being a great addition and a huge distraction.
It's more enriching to imagine the voices in your head usually. If the VA isn't speaking English it's harder to get distracted by terrible acting because I can't understand the difference at least