Yes, you're gay or bi. You’re attracted to men—but a specific type, not all of them. Just like I’m attracted to women, but not all kinds of women.
But, there’s nothing wrong with liking men, women, both, or neither. It’s not a big deal — or at least, it shouldn’t be.