It actually makes sense in most cases if you're planning to stay there long-term! Oil heating is really a dying breed - prices are unstable and those things are total energy hogs. With a heat pump you'll save a decent amount on heating costs, especially if you get subsidies (KfW and that sort of thing). 25,000 euros sounds like a lot, but if you add up all your oil expenses over the years, it definitely pays for itself - plus the CO2 tax makes heating with oil more and more expensive. That said: it also depends on how well your house is insulated! With poor insulation, a heat pump won't be as efficient.
When it comes to electricity costs, I've gotta be honest - they're going to go up. Electricity is more expensive than heating oil per unit of energy. But heat pumps are just so much more efficient that your overall costs still drop. Especially if you maybe put solar panels on your roof later on, it pays for itself even faster. Some people report breaking even in 10-15 years, so totally reasonable for an installation like that. What matters is: get proper advice beforehand and have an energy audit done - that way you'll see exactly whether an air-to-air, air-to-water, or ground source heat pump makes sense for you!