Actually, I do encounter that scenario pretty frequently. When that happens, I bide my time behind the slower pedestrians/joggers/stroller pushers until it is safe to pass. I may even dismount, jog my bike past them, and then move on. It's really not that hard to do. I think my eyesight is good enough that I can see oncoming traffic before I do things like swerve into the next lane. Even while driving, I don't think I've ever had to wait more than 30s before passing a cyclist or a scooter rider. I can certainly afford to take 30s into account when planning my commute. It's a give-and-take, and so much more pleasant on everyone when people are patient and nice, don't you think?