Brother in law coming on strong

Well me and my husband have been together for 5 years ,and we are really happy , but there's a problem , his brother , he tries to make me and me husband fight and he flirts with me, makes inappropriate comments about my breast and bottom and I don't know if to make a big deal of it , another situation is we where all drinking and he tried to kiss me , of course I pushed him away , but I didn't not tell my husband , I feel very bad and I don't want to cause any trouble in between brothers ? Any advice or thoughts ??