Is washing your hands before leaving the restroom only important because......?

you've touched surfaces/things that counless other people have touched? before I get into my question, let me state that no one in the world is more conscious about washing hands than I am. in fact in many cases I wash my hands before AND after going to the restroom. I can understand why it's important to wash your hands after touching things like the sink, flush handles, and doorknobs, but isn't it equally important to wash your hands after handling your ? even if you're someone who showers on a daily basis and is a clean person, it is just imprinted into my mind that you are doing a courtesy to others as well as yourself to still wash your hands off after touching those areas, even if you just showered hours before. I'm asking because I've been reading different things suggesting that the fact that they touched their own is mostly the LAST reason people wash their hands before walking out of the restroom. that's kinda gross and bothersome for me. have I been wrong all these years?