Trans men tend to look more like their cis gender "peers". After facial hair and muscles, there's not much to hide other than chest scars from Breast tissue removal. Most people are not going to ask to see a dick if the body and face match up.
A Trans man can go to most gyms and no one would bat an eye in the locker room. They could be a Never Nude and with boxers for underwear there's no obvious print or bulge expectation. A Trans female would have a much more difficult time in a similar environment.