Paleo lifestyle and exercising junkie!!

So I am currently TTC month 18 hoping for my BFP this month but I have a question I started the paleo lifestyle I don't like to say diet I like to have a change. Well is that safe if I am pregnant. I mean if any of YALL know what the paleo diet is only eat grass fed meats, veggies and natural fruit. Cut out dairy and sugar and all the processed food. Also I work out and lift weights like Crossfit. I was just wondering. Any advice is welcomed :)