Out of no where someone that I work in the same industry with made a inappropriate comment “Sleeping your way to the top”.

The context here is I work as an assistant and he is a very well known figure in the industry. I have never had any sexual interaction with anyone within my industry. I am 21 and he is in his 30s

When I replied “I don’t think sleeping with anyone will ever benefit me” he said “yeah not even that will help you..”

I feel trapped that its not worth telling anyone due to the hierarchy of where he stands and where I sit. Calling him out could really effect my future career.