Your 500W amp is going to pull way more current than any phone charger can supply, and that's where things fall apart. Even if a USB-C charger claims high wattage, it's designed to trickle power into a battery over time. An amp draws current *constantly* and in spikes, especially when the bass hits. The charger would overheat almost immediately, possibly catch fire, and your amp wouldn't get enough juice to actually amplify anything beyond a whisper.
The real issue nobody mentions much is voltage drop. Phone chargers step down to 5V or maybe 20V, while a car amp needs the full battery voltage - typically around 12V for most setups, sometimes higher. Even if you somehow jury-rigged the voltage, the charger's internal protection would shut it down the second it detected that kind of load. You'd destroy the charger and be stuck without it.
Running power directly from the battery isn't as scary as it sounds. You don't necessarily have to drill through the firewall - you can snake the cable through existing grommets where other wires already go, along the edge of the firewall, or under the rubber trim. It takes time but it's the only way to do this safely.