Grammer would definitely be a troublesom point with realtime translation, as different languages structure the relationship between nouns, verbs, and adjectives differently. That being said, I think that is a severely minor issue. Most people are able to decifer the meaning of phrases in their native tounge, even if the grammer isn't perfect. If google tanslate tells me that "the red car moved", "the moved red car", or "the car red moved" I will still have a pretty good idea what's being said.