Were you crossing in front of him from his port side by chance? If not, he was being a jerk. If so, you were in the wrong. He would have been the stand on vessel, and you were supposed to give way. (Rules of the road).