How do you handle dietary restrictions with your caterer without going insane?

We're trying to finalize our menu with the caterer and suddenly half our guest list has sent in dietary restrictions - gluten-free, vegan, shellfish allergies, the works. The caterer wants to know exact numbers for each thing. Should we just pick a few main options or try to accommodate everything?