If he asks you to cook for him next time, you should ask him to call you first.
It doesn't matter. You don't have to be embarrassed. You must slow down because of him. That's why you're the first person to be wrong. If he, uh, talks about you everywhere, you don't have to go easy on him.
This kind of person can't make friends, and there is no necessary intersection in the future, so he doesn't need any face.