I always wear my base layer due to ticks and my fear of contracting Lymes disease. I have a thin set for early season and I just wear my 3-D "leafy" suit over that. I still sweat and all, but rather risk that then Lymes. I have UA cold weather gear for late season and I put on layers of fleece and then my outer layer over that.
