Replaced our entire system (furnace, a/c) mid last year. Heat pump with backup oil for colder days.
We cut the amount of gallons we used by over 50% compared to last year. Sure the oil infrastructure is needed to get it delivered (I wish we didn't need it) but I'm very happy that our heating (oil+electricity) bills are so much lower, even with the increased oil prices.
We went with a mid-range system but now I kind of wish we sprung for the "Cadillac" version.