Choosing what to wear on a ride should always include looking at the weather forecast. Consider how warm it will be mid-ride and where you're headed, as well as the weather conditions towards the end. A lot can change in a couple of hours; don't be caught in a headwind with no wind breaker.
Pro Tip: Try to plan your ride so you can take advantage of both daylight, warmer temperatures and even wind direction.