How often does it happen - does he just glance at it quickly or spend more time on his phone than with you?
I think you have to look at it differently. If someone just checks a message real quick, that's annoying but not the end of the world. But if he's constantly scrolling or typing while you're talking, then yeah, that's actually rude - not because he's trying to ignore you on purpose, but because that's how it comes across. The other answers are right that it often becomes an unconscious habit, but that doesn't make it any less frustrating for you.
I wouldn't bring it up the next time you're eating if the situation comes up again. That'll just put him on the defensive. Better to ask him in a normal conversation whether he's noticed that he's on his phone a lot when you two are together. Not like you're accusing him, but more like you're genuinely curious. A lot of people don't even notice it about themselves. He could also be stressed about something else - family, work, whatever. That doesn't change the fact that it bugs you, but it helps to figure out if it's just a habit thing or if there's something else going on. Once he knows about it, he'll probably catch himself doing it and try to stop.