A thin thermal base layer keeps you warm without bulk. Add a regular tee or shirt on top, then a jacket for going out.
Remove a layer indoors and you stay comfortable all day.