I hate spring and summer too.
For me, when the days are shorter, when it's dark and cold and grey and the weather is miserable, I can stay in my bubble. I'm more invisible. People are not outdoors being visibly happy and having fun, so I don't feel as alien and apart from the rest of the world.
When spring comes around, everything is brightening, like a new life cycle is beginning, and outdoors is full of people enjoying life. It reminds me of how my existence is different: my existence is dark, and cold, and miserable. So I prefer the days to mirror my feelings.