While I will agree that speaking in only Klingon as an adult will effect your social life, I fail to see how having Klingon spoken to you as a baby will impact your adult life in any way.
I cant speak from experience here, but from what I have seen, many Trekkies have great social lives. There is a huge active community for people who enjoy it and I am assuming they are very happy with it. Looking down on people who have different interests than you is so childish.
Also, if he did grow up to be a Trekkie and spoke Klingon fluently, I am sure he'd be a big hit with the Trekkie ladies. Jus' sayin.