The sweet spot for kayak fishing on a tight budget is going with a castable sonar unit paired with a basic smartphone app - something like the Deeper Pro or comparable brands in that $200-250 range. You cast it out, it sinks and starts mapping the bottom, and you get real-time depth and fish returns on your phone. No complicated mounting, no permanent installation, and you can swap it between kayaks in seconds. The main thing people miss though is that these wireless units have a battery life that's nowhere near as long as the marketing suggests - I'd be realistic and expect maybe 6-8 hours of actual continuous use before you need to recharge, not the 10+ hours they claim. Plan your fishing trips around that, or bring a power bank if you're out all day.
The other approach that works is going older or refurbished with brands like Humminbird or Lowrance. You can find older fixed-mount units for $150-200 on the used market, and while they won't have all the bells and whistles, they're rock-solid for showing you depth, underwater structure, and whether fish are actually there. The tradeoff is you're locked into one kayak unless you want to deal with unmounting and remounting. If you're just starting out though, the castable wireless option gives you more flexibility while you figure out if you're even going to stick with the hobby.
What depth are you typically fishing in? That matters because some of the cheaper units get wonky in shallow water under maybe 4-5 feet, and if you're in super deep stuff over 100 feet, you'll want something with better range.