If you don't exercise regularly, your resistance is poor, and you wear less, you will definitely freeze.
But don't wear too much if you exercise in winter. Autumn trousers and a cotton sports coat will do.