For me it depends on the time of year, In summer, 32° is trending toward uncomfortable outside but in winter it feels warm out. I most likely wouldn't bother with a jacket unless it was windy. Just a long sleeved liner with a t-shirt over on most days. Once it gets closer to zero, I add a flannel shirt and maybe a jacket for short trips outside. You get used to it.
Wind changes everything. I have an oilskin for wind and driving snow. That

I can do without, esp when temps really start plunging.

So, bitter cold? Around -15 I start feeling kinda bitter.