That is certainly true. The people who designed and developed GPT and related LLM-based systems admit that fact:
Mihai Nadin: [ChatGPT] is syntactic. I made this claim repeatedly. It is a mimicking machine of high performance (brute computation).
But the proponents of Generative AI confuse the issues with a large cloud of highly technical terminology (AKA human generated BS). They claim that if they increase the amount of data to some immense amount, they will have covered all the options so that the probability of finding a correct answer will auto-magically converge to 0.9999999....
They have persuaded Elon Musk and other gullible investors that by pouring more billions and even trillions of $$$ into building ultra-massive computer systems, they will magically become ultra-intelligent.
Unfortunately, the WWW has huge amounts of false, fraudulent, mistaken, misled, social media, espionage, counter-espionage, dangerous, and disastrous data. Detecting and deleting all that garbage is extremely difficult. People have tried to use LLM-based technology to find, evaluate, and erase such data -- and they have failed, miserably.
As I have repeatedly said, anything LLMs generate is a hypothesis (AKA abduction or guess). Before any abduction can be accepted, it must be evaluated by deduction (AKA reliable reasoning methods). There are almost 80 years of reliable methods developed by AI and computer science. They are essential for reliable computation.
All commercial computing systems that require high reliability (banking, engineering, scientific research, aeronautics, space exploration, etc.) require extremely high precision. They also use statistical methods for many purposes, but they use statistics with precise error bounds.
Those high precision methods control the world economy and support human life. None of those computations can be replaced by LLM-based methods. Many of them can benefit from LLM-based computations -- but ONLY IF those computations are EVALUATED by traditional deductive methods.
John
From: "Nadin, Mihai" <nadin@utdallas.edu>
It is syntactic. I made this claim repeatedly. It is a mimicking machine of high performance (brute computation).
Mihai Nadin
Sent from planet earth