I don't think you'd say the same thing to a white person saying that Black people should not be allowed to celebrate a national holiday. If you're prepared to happily listen to white people strip away the rights of Black people, then that's fine - you can also happily listen to Black people strip away the rights of white people.

Fighting racism does not mean fighting for the rights of one ethnicity or group - it means fighting for all.