Limescale is indeed the culprit in most cases, especially with the hard water you've got. Before you spend money on specific descaling products, try this: unplug the water tube from the back of the fridge (turn the appliance off first), detach the tank if it's removable, and run hot water mixed with a bit of white vinegar directly through the internal tubes using a large syringe or spray bottle. Let it sit for 20-30 minutes, then rinse thoroughly with cold water. If the dispenser is still blocked, the problem might be in the internal solenoid valve of your Samsung, which is harder to reach.
On the filter thing: yeah, change it more often like they suggested, but I'd add that the real problem isn't so much the filter itself but the fact that limescale builds up in the tube AFTER the filter, in the narrow part that goes to the actual dispenser. The filter gets rid of most of the impurities, but with really hard water the limescale still gets through and crystallizes in those last centimeters, where the tube is narrower. A generic descaler shouldn't damage the filter, but honestly with water as hard as yours it'd be way more useful to install a water softener upstream, even a small one. If you don't want to spend that much, at least use distilled water in the fridge tank for a couple of cycles every now and then - it's cheap and cuts down on clogs dramatically.