How to tell if it’s a cold or just pregnancy stuffiness

I’m 17w6d and for the past several weeks my nose has been stuffed up and when I blow my nose it’s bloody. I went to the doctor weeks ago and he seemed to think it was a cold but I really don’t think it is, and the reason I don’t is because when I’m not pregnant this would have gotten worse but it’s pretty much remained steady and hasn’t gotten any worse. I’m hesitant to take cold medicine. It’s just something I would rather not take. The stuffiness gets worse in the evening when I sleep and then wake up in the morning. Any of you ladies experience this? Is it more harmful that I’m not taking any medicine for this? I worry if it IS a cold it will be passed to baby but my instincts tell me it’s just pregnancy related because as I said it has not gotten any worse.