I just tested Google vs ChatGPT search — and I’m shocked by the results

Nov 1, 2024
1
2
10
This is a contextually unfair, head-to-head. Google has had Gemini searching the web, going all the way back to when it was Google Bard. It did it so well, Google had to actually reduce functionality to prevent access to paid content, for example for academic journals. Gemini and the Gemini-specific part of a Google search do every bit as well as ChatGPT "search," which is really just adding a feature Google has had for awhile. Also, it's super friendly; you just have to demonstrate excitement for a topic, rather than asking something quickly that can be referenced.
 

John Fox

Distinguished
Sep 3, 2014
7
2
18,515
I prefer see the articles directly so I can validate context instead of some AI word salad that I still need to review the articles to see if it's accurate. I've seen too many errors in what is dubbed 'AI', which should be renamed 'AG' for 'Advanced Guessing' or 'AR' for 'Advanced rewriting' as there is no intelligence involved. I've seen AI summaries that contradict themselves in different paragraphs and a few that were just outright wrong. It requires those that know how to use search engines to scroll down further to the real results instead of the artificial ones.

There are some great uses for 'AI', especially in the areas of pattern recognition and image processing. But I'm not convinced providing accurate answers to questions is one of the uses it's ready for. Especially to the unskilled.
 

Icylobster

Distinguished
Sep 24, 2009
8
1
18,510
I get the criticism, but at the same time I'm not surprised. Google search keeps getting worse, they keep updating it to make more money, have more ads, and constantly show products.

I tried Kagi search and it felt so much better. Much more like the old Internet where you found unique websites that are more relevant. Google shows the same stuff constantly.

Google will probably learn the wrong lesson from this and just add more Gemini to their search. What they really need to do is debloat the results. I tried Perplexity search (very similar to ChatGPT search) and it's great at some stuff but very bad at others. Maybe ChatGPT is better, but I think Google would be fine if the just de-crappified their search engine, but that would mean less $.

Overall it's good they get competition, I stopped using Google search. However I'm not sold on ChatGPT search either. Generative AI is not perfect.
 
  • Like
Reactions: DGNC
Nov 1, 2024
1
1
10
As many of the other commenters mention, this is a strange "head to head" comparison.

Chat GPT should be evaluated against Gemini if anything. Google search can do some translation features, but I wouldn't put it head to head with a dedicated translation app, especially when Google has a standalone translation app.

Chat GPT is also a startup running off a mountain of VC capital. They have no need to make any money. Once they do have to monetize to stay alive, you'll probably get a different experience. The cost of Chat GPT vs Google Search would probably put Google ahead, but it's not really mentioned.

Finally, it's puzzling to me that the headline reads Google vs Google Search. It feels sloppy not to clearly state the exact details of the comparison. It's like saying Adobe vs Midjourney without specifying whether it's Photoshop or Firefly or something else.
 
  • Like
Reactions: DGNC
Oct 31, 2024
4
0
10
I think The chat GPT would be better without the chat part of it. I like my answers to be concise facts without the filler. I'm really not looking for conversation when I'm looking for hard facts and data. If I want conversation I will find a human being and have a true conversation with meaning and emotional responses.
If you had the option is setting up chat GPT with more user choices about how he answers are presented then it could be a winner.
 
Nov 1, 2024
1
0
10
Next she can compare TikTok with Wikipedia and declare TikTok as the best short video platform. ChatGPT always won for showing no ads but they are burning billions in VC money which isn’t sustainable. This comparison is funny than useful.
 
Nov 2, 2024
1
0
10
As many of the other commenters mention, this is a strange "head to head" comparison.

Chat GPT should be evaluated against Gemini if anything. Google search can do some translation features, but I wouldn't put it head to head with a dedicated translation app, especially when Google has a standalone translation app.

Chat GPT is also a startup running off a mountain of VC capital. They have no need to make any money. Once they do have to monetize to stay alive, you'll probably get a different experience. The cost of Chat GPT vs Google Search would probably put Google ahead, but it's not really mentioned.

Finally, it's puzzling to me that the headline reads Google vs Google Search. It feels sloppy not to clearly state the exact details of the comparison. It's like saying Adobe vs Midjourney without specifying whether it's Photoshop or Firefly or something else.
As a long time Bard and Gemini beta tester. I agree 100% with this comment. I also test out other LLMs, but not as a beta tester.
I agree that Google's Internet Search has become annoyingly full of ads.
Also, I don't know if this is just a beta tester feature or if everyone sees this when searching using Google's Internet Search engine, but I have been seeing an AI response to my Google Search queries first at the very top of the typical search results one usually sees in the Google search results. Along with the annoying "This is an AI generated response, please verify any facts" warning. I suspect we will see this warning for many years since AI often will hallucinate and give you ridiculously inaccurate results.
I guess I should go test my Google Search in incognito mode to see what results pop up. In fact, I will do so after this post.
Also, to the writer of this article.
Your Article should have said "I just tested Google Search vs ChatGPT Search and I was shocked".
However, in your defense the term "Google" is synonymous with Internet searching, so I understand why you simply put Google.
However, you shouldn't have been "shocked" when comparing a LLM (ChatGPT) to Google's Internet Search Engine. It appears that Google is putting most of its resources into "AI" versus keeping their old Internet search engine top notch. But that's easily explained
I fully expect that most "AI" (LLM) being created today will eventually go behind a pay wall (Especially since people are holding onto their phones for much longer now.) and additionally (unfortunately) just as the free (full of ads) Google Search Engine seems to be getting worse, I have noticed that "Google Assistant" that I use with my Android home devices (Google display devices especially) have actually become dumber and has stopped answering most of my queries vocally and instead it shows me search results on the screen that one cannot see from across the room which is very annoying.
This may be intentional by Google, or perhaps it's just a side effect of moving all the Google Assistant "smarts" over to Gemini, or perhaps Google hasn't yet moved Gemini to its Home devices yet. I don't yet know. It's a transition that hasn't fully played out yet.
I'll end with this. These LLMs are getting exponentially better and faster rather than the typical upward smooth trajectory curves we most often see within the computer science and technology fields.
The "free" AI that most people will see most likely will be slightly suboptimal compared to the "paid" better more accurate versions. That's by design and planned by these companies. You either pay with lots of targeted ads or pay with your wallet like most Android software. But all companies have moved to SaaS models rather than pay once and you own it. Think Office 365, or Kindle books for example. You own the Kindle reader device but the SaaS are the ebooks.
 
Nov 2, 2024
2
1
15
The comparison was not fair.
Google does search for keywords. All the examples in the article are conversation styles prompts.
 
Nov 2, 2024
1
1
10
Verifiable information from ChatGPT? Count me very dubious. As an college professor I've seen ChatGPT churn false or inaccurate information, make up sources, and fail in other ways. Not to claim Google doesn't have issues but the methodology here makes me wonder if my trust in Tom's Guide has been misplaced.
 
  • Like
Reactions: DGNC
Nov 2, 2024
2
1
15
The comparison was not fair.
Google does search for keywords. All the examples in the article are conversation styles prompts.
I tried searching for chia. Google gave me also places where to buy. Chatgpt was only talking about what is good for and recipes and such. It can happen I do a search with intent to buy not to learn.
 
  • Like
Reactions: droideka75

droideka75

Prominent
Aug 16, 2023
8
2
515
Now do it with real prompts. Nobody writes a sentence... You may speak it but it's inconvenient in certain scenarios.

So a real prompt is like "Apple stock" "Trip Paris" "election polls" and the one that everyone uses but nobody says: insert your preference and then "porn". I sure hope there's not a conversation reply there... I don't want to have a conversation about this, just show me some results.

Actually I don't want conversation results about almost anything. I already have to talk to real people giving me lengthy replies as it is. Use AI to search all you want in the background and then give me the results would be better.

I think AI is very useful for tasks like programming and writing, upscale and yes, search. But the interface must be way simpler.

Google search didn't succeed because it had features. It succeeded because it was extremely simple to use.

These aí conversations feel more like Yahoo...

Also what kind of suggestion it makes to complete my question?
 

droideka75

Prominent
Aug 16, 2023
8
2
515
I tried searching for chia. Google gave me also places where to buy. Chatgpt was only talking about what is good for and recipes and such. It can happen I do a search with intent to buy not to learn.
This is what I'm talking about on my comment. Simple one or two words prompts.
 
Nov 3, 2024
1
0
10
This is bogus... Running a query against both, GOOGLE gave me results. ChatGPT did NOT...

What are the current polls in the swing states for the US presidential election?

ChatGPT said:​


I might not have the latest updates. For the most complete and up-to-date information about the U.S. Election, please visit news sources like The Associated Press and Reuters or check with your state or local election authority.
 
Nov 4, 2024
1
1
15
I tried a basic search on chatGPT asking how many lounges are there at Islamabad airport (my home airport where I fly to frequently). It gave me the wrong answer. I entered the phrase that "this answer is incorrect", and it gave a different set of lounges (some fictitious). I again said it was incorrect to which it generated a news answer listing some other lounges, this time with "sources" mentioned. Not only was the answer again incorrect but I visited those links and they did not mention what it was generating.

So, not only was the answer wrong and different multiple times, but the references or sources mentioned were also wrong. Needless to say no matter how aesthetically it is presented, it is still unreliable at this stage.
 
  • Like
Reactions: droideka75