> So... That's a no?
It's also a clarification between "I would like to, but no thanks due to these other circumstances, maybe another time" vs "No, would not like to, probably not ever." It's also giving you the opportunity to counter-offer, as it were: if you're not particularly hungry either, so maybe something more like a small appetizer and a drink?
Plus a million other options, of course.
It's not really a yes or no question to begin with, even if you're thinking of it that way.