I don't know. If someone told me "I just want to be with white people", I would think they were racist. That said, the word racism definitely has multiple and nuanced meanings at this point, so it could be more a part of my interpretation than the more established official definition.