1. If all the "sacred caste" wants is to be treated normally and not abused, slandered, it's hardly the same as something like clergy.
2. The reason clergy and TV entertainers are able to abuse people is because of power, reputation. And the ability to isolate their targets. Some rando non-binary person isn't able to go "if you tell anyone what happened you and your family will burn in hell forever, and they'll believe me."
3. Street gang members? As a sacred caste? The fuck are you on about? Unless you're talking about something completely different, not only are street gangs not a sacred caste by any real metric, but the reason they can act with impunity in a depressingly wide range of activities is because the communities they prey on are often poor and can't trust law enforcement to help. It isolates the community and makes further interactions with law enforcement more difficult, feeding into the negative cycle. Adding gangs as a point helps solidify the fact you're full of it.
4. By your own... loose... logic, there really isn't anything to be done because it's less about the caste itself (excluding gangs, you idiot) and more that people who want to prey on others will join up with areas they can do so. Clergy wasn't "set up" to diddle kids. People didn't go "I want to be entertained by watching a movie or a play... but the only way that can happen is if the performers molest children." It's a fact of life some people are shitty predators. To say an entire group is just full of sexual predators is ridiculous.