No sure about. Were Union soldiers acting as racists when they raped slaves? One can argue they were and it's a reasonable argument. Did Confedrate soldiers rape escaped slaves? Possibly yes since Wheelers men joyfully killed escaped slaves trying to follow Sherman's March through Georgia.Again, let's not dilute the the immediacy of what happened in the Civil War by comparison to what happened in other major wars.
To bring up that rape is just "what happens in war" distracts from the unique setting of what happened to African-American women in the Antebellum and Civil War period, and it borders on excuse for not giving the specific topic a more thorough analysis.
If we're going to throw rocks at Union soldiers for rape must we be silent on mostly Southern soldiers raping Mexican woman less then twenty years earlier?
Are Southern women more precious then other women that American soldiers have raped over the years and yes Southern men just as raped in uniform as any other region?