You bundle up, add another layer, and you're still cold ten minutes into the walk. When you stand still at a bus stop or on the sideline, your body stops making heat, and the cold gets into your back and chest.
Thicker coats only slow down heat loss. They make you bulky, then you overheat the second you walk inside. Disposable hand warmers run out, and you're back to shivering.