I love this board for confirming to me that I'm not alone.
Everything that everyone's said is how I feel, but I thought it was me and I somehow had to fight it / beat it. I live in a town where the only way out is along fast (national speed limit) roads.
I ended up doing a mad thing starting about 6 years ago. I upped the challenge. I went back to riding a motorbike. Insane. But oddly not. Most bikes have much faster acceleration and a lot more visibility. I don't know how, but it's less scary. It's like I can feel the world, it's really there, a concrete reality I understand how to respond to. And the responses are very direct.
Anyway, it hasn't helped massively (although I can do a steady 60 whereas before I was kind of struck at 40). Have to say, it's also pretty cool that I ride a red cruiser. It's a confidence bump.