If you want to join a group that is all white, you should be able to. If you want to join one that is all black, you should be able to. If you want to join one that is mixed you should be able to.
None of those groups should be forced to look like the other.