Hmm, I guess it mostly has to do with how well those people pass in real life. I think a lot of trans guys who don't necessarily "pass" mainly just want the typical dude bro talk between guys, maybe being seen as masculine and someone you can depend on, strong, casual joking around. That's kinda how I grew up seeing men, and it's a good feeling sometimes when people feel safe with you or you can joke with each other, and also playing sports or wrestling where they don't view you as weak and actually put in the effort. Obviously, it has its drawbacks, like even though some people do feel safe with you, it's clear a lot don't. I've noticed this when sitting on the bus, every time there's a seat open next to me and the rest of the bus is full, a lot of women choose to just stand or walk all the way to the back of the bus to sit next to another woman. I've been observing this my entire time at college and I find it interesting yet sad that, women feel unsafe around a lot of men, and men in general are perceived as unsafe (this obviously applies to strangers only). Though that can't always be the case as I myself just hate being squished between two people. There are a lot more cons of being a man, but I think trans people are (for the most part) ready to face the consequences that come with being the opposite gender. Like trans women don't try to pass so they can be catcalled on the street and sexualized by others, it's to deal with their own gender dysphoria. I completely understand the anxiety, some people think of us as a fetish or these cute little things that need protection. So I truly feel for those with that anxiety.
There's also that thing where they mockingly treat you as your identified gender. I remember in middle school being dragged down this (I think 10 ft tall) icy snow hill by one of my male friends, he yelled at me and told me "if you wanna be a boy, that's how you're gonna be treated". I had scratch marks all over my stomach and legs, I was bleeding and some other girl also kept making snarky remarks about me being trans. If they know you're trans, they either treat you like a baby, like you're actual gender, or they treat you worse than how that gender is usually treated. Speaking of "boys don't cry", there's an actual movie called that, it perfectly embodies this whole thing. I think that's the main part of where the anxiety comes from, being harmed.
I also know I just listed a bunch of stereotypes that come with being a man, but I think that's partly how this gender dysphoria thing is formed. I don't have any scientific proof of it but it's just my theory.