You're arguing that because a small proportion of a population does something, that entire populaton should be characterized by that segment. That leads to some interesting conclusions.

The terrorists were all Middle Eastern too (depending on where exactly you draw the lines) - why not categorize all inhabitants of the Middle East as men?

They were also all men too - why not use that arbitrary division?