Dating someone with colitis

me and this guy have been getting close recently. he has colitis and has a colostomy bag. i have genital herpes. if we were to have sex (using condoms, i take acyclovir) how safe would it be. lulupie thanks for answering