The thing people often forget is that it really all comes down to what type of panel you pick in the first place. If you're going for thin foam panels or ultralight absorbers (like less than 500g per unit), reinforced adhesives like the ones you find at hardware stores will hold just fine. But before you glue anything, you absolutely need to clean your wall with a dry cloth or some isopropyl alcohol to get rid of dust and grease marks - it makes a huge difference for adhesion.
Now, here's the hack nobody mentions: instead of gluing the panels directly, you can attach them to really thin wooden strips (like 20x20mm) that you glue to the wall yourself with heavy-duty wall adhesives. The strips distribute the weight better and give you more flexibility to remove the panels later without causing any damage. It's a good balance between durability and reversibility. The other option is freestanding acoustic panels on stands, zero wall mounting, but that's less discreet in a small office.
For any leftover adhesive residue when your lease ends, keep some isopropyl alcohol on hand and be patient - you can also ask your landlord if you can test it first on a hidden spot behind some furniture.