You are not missing anything! If you love to fly go for it! I find it depends on the distance obviously as the further you travel the better it gets. I fly from BALLARAT up to NSW and into South Aus regularly and find it saves masses of time as well as stress. I arrive relaxed and ready to go as I have not been wrestling idiots, trucks, police etc etc
Sounds like you do not have time pressure which is excellent. I find to get over the weather issue I plan to go the slow way and if the time comes and the weather is good then I go the fast way. I tend not to plan so much in winter obviously and I like to get away early when possible. If I get stuck I leave her where she is and get home some other way. Only been stuck once so far. There's always another way home.