Frost is genuinely dangerous not just for the battery, but also for the screen and the motherboard. In the cold, the liquid crystals of the display freeze and become viscous, which is why the screen can show colorful spots or not respond to touches at all. And if you suddenly move the phone from frost to warmth, moisture condenses inside, which can cause short circuits. So it's not just "the phone died and that's it," it can lead to real damage.
Practically speaking, these things work: keep your smartphone in an inner jacket pocket or closer to your body, where it gets heat from you. If you've already taken it out in the cold - don't throw it into warmth right away, let it sit in the entryway for 20-30 minutes so condensation doesn't form. I also use a regular thick sock instead of a special case - cheap, works great, and the fabric absorbs moisture. Turn on airplane mode in frost - it reduces the load on the battery and processor. And generally don't mess with your phone unnecessarily when it's cold, let it warm up.
The previous answer was right about battery degradation - it really can be irreversible. But the main problem is that people don't even notice when it starts happening. The phone just becomes "not the same as before," drains faster, and then it turns out the battery is already half-dead. So just keep an eye on it: if you're out and about outside a lot in winter, don't keep your phone in the frost longer than necessary.