Well yeah, just like being anti-racist can be racist. You can only push so far in one direction before it becomes the wrong you were trying to right.
An example of being so fair, it is unfair is how the college system works in the US. Asian Americans are held to a much higher standard than everyone else which is unfair while black American students are held at a much lower standard which seems like it would be fair but it really isn't, it is actually kind of racist. There is a lot of this right now and you can't really talk about it without someone getting mad.
A less social-political take would be to give everyone on a losing team the same reward as the winning team just to "be fair" which kind of takes away from the team that worked hard and won.