That is a result of the perception that those groups work against the state, not a requirement for fascism. Communist systems have just as bad if not worse a track record in regards to minority oppression as fascist ones.