The random spikes you're seeing when sitting down are probably just the sensor struggling with your wrist position or skin contact - totally normal and not a sign the thing's broken. Where it gets more interesting is that optical heart rate sensors actually do pretty well during consistent activity like running or cycling, but they can lag or get confused if you're doing anything with a lot of arm movement (like rowing or boxing) because the sensor bounces around too much.
The real limitation is that wrist-based trackers measure blood flow through capillaries under your skin, which isn't the same as a chest strap that picks up electrical signals from your heart. So yeah, it'll give you a ballpark number that's useful for trends - like you can see "my HR dropped 10 bpm over the past month" - but don't treat it like gospel during high-intensity work. If you're trying to nail specific heart rate zones for training, a chest strap or a medical-grade device is worth the investment. For casual tracking and seeing patterns, your watch is doing fine even with the occasional weird reading.