Should Guys Wear Swim Trunks As Shorts In Public

I know everybody has an opinion about whether jeggings and yoga pants actually count as pants, but here's a new one. Do swimsuit trunks actually count as shorts?

Honestly, the guy circled above in red gets it. I had no idea, but apparently this really bothers some people. And I am very guilty! I wear my board shorts all the time, and I probably do it for the same reason women wear the jeggings. They are really comfortable.

Are you bothered when guys wear their swim trunks when they aren't at the pool?