The best way to understand what's happening is to look at habitat loss, food availability, and the simple fact that deer populations in many areas have grown a lot over the past couple decades. You're probably seeing a combination of these factors. Forests get developed, natural food sources get cleared, and suddenly your neighborhood with its gardens, ornamental plants, and lack of predators looks like a pretty good deal to a hungry deer. They're not necessarily fleeing anything dramatic - they're just taking advantage of easier resources.
The shift you're noticing is pretty normal in suburbs and towns near forests or green belts. Deer are fairly adaptable and lose their fear of humans pretty quickly when there's no hunting pressure or other threats. They'll absolutely wreck a garden, eat shrubs down to stubs, and create a mess, but they're not aggressive toward people unless cornered or protecting fawns. The real concern is more about property damage and the fact that concentrated deer populations can strip vegetation bare and mess with local ecology.
If they're becoming a nuisance, you've got options: fence off gardens with tall barriers (they jump high, so this needs to be substantial), remove or protect plants they love, or use repellents that taste or smell bad. Motion-activated lights or sprinklers sometimes work too, though deer can get used to them. Some neighborhoods eventually just accept it as part of the landscape now - it's become the new normal in a lot of places. The deer aren't going anywhere, and they're not sick or in danger, just living their best suburban life.