With thick brick walls from 1905, a heat pump definitely works, but the tradespeople have a point - you just gotta look at it more carefully. You can install an air heat pump relatively straightforwardly without a ton of digging around, and with energy prices the way they are, it pays off. The real problem is that an old house like that with poor insulation needs high flow temperatures, and that's where a heat pump becomes inefficient. But that doesn't automatically mean it's not worth it financially.
I'd think about it differently than most people do: insulation is nice to have, of course, but if the financial reality is that you need to replace your heating system now, then you're better off getting a heat pump in there, even if the conditions aren't optimal. You'll still save money compared to oil, and in 5, 10 years you can gradually improve the insulation (new windows, maybe exterior insulation later on). My cat's always sitting on the thermostat, so this whole topic gets on my nerves regularly 😄 But the important thing: have an expert come check out what your actual heat demand is. They can then tell you whether an air heat pump makes sense or if you still need gas as a backup. Whatever you do, don't just go ahead and install it without thinking.