If you're bilingual

Do you think it's possible for me to raise a bilingual baby if I'm not exactly fluent in the second language? I have basic conversational ability in Spanish and would like to teach my daughter that when she's born, only speaking to her in Spanish while my husband speaks English. I know simple words and conversation, the kind you'd talk to a child with, and would expect to learn more as she does. Is it totally hopeless and I shouldn't try to confuse her/overestimating what I'm capable of? Or could it work?