It seems some people just do not have a filter, or as they get older don’t care if they offend or not. I would think that “You’ve gain weight” would be something that no one said to any casual acquaintance, though.
If you had been a bigger person I am sure you wouldn’t have taken it so well. I am glad he followed by adding you looked great.