At least 21 Black staffers have left the White Ho