I absolutely loathe this cultural narrative that a rape accusation is some kind of destructive rumor until there is physical evidence or an eye witness. We don’t require that of anyone else reporting a crime. An accusation is enough to trigger a further investigation, an arrest if so warranted, etc.
In almost 100% of cases that go to trial, there is no such clear cut evidence and the jury has to weigh the testimony of both parties to determine who is the more believable. It’s not a perfect system, but it does demonstrate how our system operates in the case of other types of crimes.