It's the context where it really pays off. I don't drive much, but a friend of mine who works as a courier and spends the whole day making deliveries downtown told me that with a hybrid she's cut fuel costs quite a bit compared to the regular car she had before. The engine shuts off when you brake or you're sitting at a red light, and the battery recharges itself during braking, so you're not wasting energy like you do with a traditional car.
The thing that matters is understanding how much you're actually spending right now. If you're doing like 100-150 km a month all in the city, the savings could be interesting and pay back the extra price in a few years, maybe 5-6 years depending on the model. But if you often get out of the city and drive on the highway, then the game changes, because there the hybrid doesn't give you much of an advantage over a regular gas car and you're just burning through that extra money without getting it back.
Honestly the real cost is the upfront one. If you can make up the difference over the long term with what you save on fuel, then yeah, it's worth it, especially if you keep the car for several years. If you're thinking of changing it in 4 years, maybe not.