Chair height and breaks are good, but they're not gonna solve this on their own - the real issue is usually that your whole setup and your body's conditioning are fighting against you. Most people who sit all day don't realize how much of the problem is weak core muscles and tight hip flexors. When those go, your lower back has to compensate and takes all the stress. You need to attack this from multiple angles at once.
Start with actual strengthening exercises, not just stretching. Planks, dead bugs, bird dogs - stuff that builds core stability without needing equipment. Even 10 minutes a day makes a difference. Also look at your desk setup beyond just the chair: your monitor should be at eye level so you're not hunching, and your keyboard and mouse need to be close enough that your arms aren't reaching. A lot of people forget that slouching forward puts insane pressure on your lower back. Getting a standing desk converter or switching positions throughout the day helps too, but standing all day isn't the answer either - it's the switching that matters.
The other thing people miss is that sitting that much just tightens everything up. Spend a few minutes daily stretching your hip flexors and hamstrings. If you've been dealing with this for two years and nothing's working, it might be worth getting evaluated by a physical therapist or doctor to rule out something specific, but for most desk workers, it's a combination of weak core muscles, poor posture, and no movement variety. Fix those three things and you'll see real improvement.