Soon-to-be-Doctor

I’m a PhD student at a university and live in a huge university managed shared house with about a dozen other PhD students from various countries, one of them is an older man (in his forties) who makes me horribly uncomfortable because he often makes comments about how pretty I am and my clothing, he once said I was “looking sexy” when I was wearing an ankle length black skirt and plain red tee shirt. He’s also made a comment that I was “getting back late” in a disapproving tone when I walked in just after 10pm on a Friday, I’m a Girl Guide leader and had just spent the whole evening running meetings.
Why he thinks he has the right to comment on my appearance and behaviour I really have no idea. It has actually got to the point that if I see him in the shared kitchen I won’t go in unless one of the other guys is there (it doesn’t help that out of the 12 of us there’s only one other woman).
Apparently he has a wife and two children back home ( according to our cleaning staff, who he has invited out for drinks several times), this doesn’t make me feel any better about him.