Your speed and behavior matter way more than the rain itself. If you were cruising at a normal pace with your regular lights on and visibility wasn't completely terrible, you're not breaking any law just by having your hazards off. Heavy rain alone doesn't create a legal requirement to use them.
The real issue is whether you were a safe, visible presence on the road. If you'd slowed down significantly or were crawling along because conditions were so bad you couldn't see properly, then yes - hazards might've been the smart call and could've been expected. But that's about defensive driving, not a fine-able offense. The cars flashing hazards around you were probably being cautious, which is fair enough in a downpour, but they weren't following some rule you violated by not doing the same.
I wouldn't worry about this one. Unless you were doing something actually reckless - speeding through spray, weaving without signaling, that sort of thing - the rain doesn't automatically get you cited. You were moving, your lights were on, and you weren't stationary or broken down, so you're in the clear.