It's not just you, though I'd push back slightly on the "getting dangerously bad" framing - they've been rough for a while now, and what's happening is more that people are finally fed up enough to actually talk about it seriously. The motorcyclist incident definitely brought real urgency to something that's been simmering, but this isn't new deterioration so much as a breaking point where folks stopped tolerating it.
The thing is, potholes aren't evenly distributed across Victoria or any state. Some councils and regions maintain their stretches reasonably well, while others... yeah, it's sketchy. Your risk really depends on your commute route and which local area you're in. If you're on a major highway, you'll probably be okay. Smaller roads in some suburbs can be legitimately hazardous though, especially if you're on a bike or pushing a pram. Worth scoping out your actual route rather than assuming the whole state is equally shot.
If your specific roads are getting worse, report them through your council's website - most have potholes portals now where you can flag locations with photos. It actually does help prioritize repairs, even if the process feels glacially slow sometimes. And yeah, maybe adjust your speed if you know the road's rough; you can't control the pavement, but you can control how fast you hit it.