name question...

My husband and I finally picked a name- Oliver! It is my grandmother's maiden name and she is the best lady I ever knew . Anyway, we both love the way James sounds as the middle name but I'm a little uneasy about him having the initials "OJ". Not exactly someone you want your kid's name to resemble! Anyway, is this even an important fact? Part of me is like, whatever who cares. Just looking for opinions!