This article is a perfect example of how legitimate research gets turned into sensationalist nonsense, and the post on Lemmy is making it worse.
The study involved 1,222 participants across three experiments. Researchers had people use AI to help with math and reading comprehension, then tested them when that assistance was removed. They found that participants were more likely to struggle with accuracy and persistence when they had to work independently.
That’s an interesting finding. It’s worth discussing.
But this whole fixation on “just 10 minutes” is ridiculous. Ten minutes of AI use under specific experimental conditions does not mean that ten minutes of ChatGPT permanently damages your brain or destroys your ability to think for yourself. The study did not demonstrate that.
There’s a pretty significant difference between showing that people can become reliant on assistance and struggle when that assistance is suddenly taken away, and claiming that AI use fundamentally erodes your cognitive abilities. One is an experimental finding. The other is an exaggeration of what that finding actually means.
And this is where I have a problem with the article and the way it’s being presented on Lemmy. The actual research is interesting enough without having to dress it up in sensationalist headlines. If the point is that people need to struggle with difficult problems to develop their skills, then make that argument. It’s a perfectly reasonable one.
But “using AI for 10 minutes erodes your ability to persist at hard things” is a hell of a lot more dramatic than what the research actually establishes.
There’s a difference between reporting scientific findings and manufacturing a narrative around them. We should be capable of discussing the potential downsides of AI without resorting to clickbait and misrepresenting what the research actually says.
TLDR: LLMs are better information aggregators than Google, which has become a mess of ads and SEO spam. Using AI to complete homework isn’t inherently cheating; homework is practice, not an exam. If schools want to measure independent knowledge, they should use supervised assessments instead of take-home assignments. And if an assignment offers little educational value, perhaps the assignment is the problem, not the tool students use to complete it.
I think the more important takeaway from this study is that people produce better results when querying LLMs than when using traditional search engines. To me, that points to a problem with conventional search more than it demonstrates a detriment to using LLMs.
Have you tried Googling anything in recent years? It’s a bloody mess. Google increasingly prioritizes what it wants you to see, and more importantly, what advertisers have paid it to show you. Finding genuinely useful information has become an exercise in digging through sponsored results, SEO spam, and pages that exist primarily to generate ad revenue.
LLMs, for all their faults, are arguably better information aggregators at this point. That isn’t necessarily a ringing endorsement of AI, considering that they aren’t particularly good at searching either. It just illustrates how bad conventional search has become.
I wouldn’t interpret using an LLM to complete a task as inherently equivalent to students cheating. I’d argue that LLMs are simply another tool for finding, processing, and synthesizing information. If students can produce better results using those tools, perhaps we should be asking why we’re so determined to prevent them from doing so rather than examining the tools themselves.
And frankly, you can’t really cheat on homework. It’s homework, not a supervised examination. Students should be able to complete assignments using whatever resources are available to them. If the objective is to determine what students can accomplish independently, then schools should assess that through supervised examinations rather than take-home assignments.
More importantly, there’s a broader question about whether we’re assigning too much homework in the first place. Research has repeatedly found that its educational benefits depend on factors such as age, workload, and assignment quality. If an assignment provides little educational value beyond producing a completed worksheet, then perhaps the problem isn’t that students are using AI to complete it. Perhaps the assignment itself isn’t worth doing.
Kagi is able to reach into Japanese websites, aggregate their information, and translate a summary of the contents for me. I used it to learn a bit about an old SNES kusoge, called Saiya no Densetu. Apparently you can get Goku to arrive before the Ginyu Force fight, but paradoxically, he has to be very low level.
This is information that a traditional search engine can’t easily grasp and present.
They make browser extensions for translations, and my SearXNG can index Japanese sites. I use it to find and download obscure Japanese music albums and ROMs. AI is a very inefficient way to achieve that result.
Truth. There is a lot of obscure searches that would go nowhere if I tried to use old-school searching. AI is the way forward when it comes to collecting lots of info and giving a cliff notes. Even better, the AI can then go into detail.
AI is the glasses of the information world: it lets people focus on getting shit done, every day.
No, a lot of them have LLMs integrated into their search engine, but they themselves are not LLMs.
The search engine I use (SearXNG) is what’s called a meta-search-engine, meaning it runs my query through several different search engines (which I can toggle on or off at will), then parses the results from all of the queried engines, strips out all of the slop bullshit, and returns me actually relevant links.
I think if you wanted to you could attach an LLM to a self-hosted SearXNG instance, but I’m not putting LLM fuckware on my system. I prefer my computations to be deterministic.
You used an AI service to determine if my comment was written by AI, and the service itself admits it can’t reliably determine that. Do you see the irony here? You literally used AI to guess whether I used AI and then treated that guess as fact. That’s some next-level nonsense.
I will say this however in my own defense not that I have to, I use Google keyboard which has a built-in AI editor it helps me to write long responses quickly.
I will use any and all tools that I deem necessary to complete any and all tasks regardless of your idiotic criticism.
Thank you! This makes me think maybe our brains reward themselves for finding easier ways to do something and LLMs become just that sometimes. But at the same time atrophying our existing skill. We need brain gyms like we do physical gyms.
Yeah my first thought looking at the title was literally… But I’m doing an extremely hard task while the dumb slop machine is doing an entirely different task.
I’m not just sitting there waiting around not thinking.
So how is that causing me to lose the ability to persist at hard things.
The article after reading it raises some good points but that head line is nonsense.
Agreed, I tend to get more interested in topics and learn more than I expected, for new neural networks. I think it’s like any tool and using it right can be useful. Our brains can make new connections learning about different topics and how they are related, systems thinking and problem solving. We can search online and read the sources directly too, and verify more with increasing importance of the topic. For example, going to defend yourself in court, do a lot of research from quality sources and still reconsider lol. Just like large claims require large evidence, same idea for other resources including llms, and no need to avoid it like it’s some new Witch panic. The energy people use daily mindlessly absorbing video streams is more than text based llm use and follow up confirmations.
Learning new things and recognizing connections between topics is beneficial for the brain, as it strengthens neural pathways and enhances understanding. This process, known as neuroplasticity, allows the brain to adapt and improve its ability to learn over time
This article is a perfect example of how legitimate research gets turned into sensationalist nonsense, and the post on Lemmy is making it worse.
The study involved 1,222 participants across three experiments. Researchers had people use AI to help with math and reading comprehension, then tested them when that assistance was removed. They found that participants were more likely to struggle with accuracy and persistence when they had to work independently.
That’s an interesting finding. It’s worth discussing.
But this whole fixation on “just 10 minutes” is ridiculous. Ten minutes of AI use under specific experimental conditions does not mean that ten minutes of ChatGPT permanently damages your brain or destroys your ability to think for yourself. The study did not demonstrate that.
There’s a pretty significant difference between showing that people can become reliant on assistance and struggle when that assistance is suddenly taken away, and claiming that AI use fundamentally erodes your cognitive abilities. One is an experimental finding. The other is an exaggeration of what that finding actually means.
And this is where I have a problem with the article and the way it’s being presented on Lemmy. The actual research is interesting enough without having to dress it up in sensationalist headlines. If the point is that people need to struggle with difficult problems to develop their skills, then make that argument. It’s a perfectly reasonable one.
But “using AI for 10 minutes erodes your ability to persist at hard things” is a hell of a lot more dramatic than what the research actually establishes.
There’s a difference between reporting scientific findings and manufacturing a narrative around them. We should be capable of discussing the potential downsides of AI without resorting to clickbait and misrepresenting what the research actually says.
“Students who cheat on their homework don’t learn as much” is a better headline.
TLDR: LLMs are better information aggregators than Google, which has become a mess of ads and SEO spam. Using AI to complete homework isn’t inherently cheating; homework is practice, not an exam. If schools want to measure independent knowledge, they should use supervised assessments instead of take-home assignments. And if an assignment offers little educational value, perhaps the assignment is the problem, not the tool students use to complete it.
I think the more important takeaway from this study is that people produce better results when querying LLMs than when using traditional search engines. To me, that points to a problem with conventional search more than it demonstrates a detriment to using LLMs.
Have you tried Googling anything in recent years? It’s a bloody mess. Google increasingly prioritizes what it wants you to see, and more importantly, what advertisers have paid it to show you. Finding genuinely useful information has become an exercise in digging through sponsored results, SEO spam, and pages that exist primarily to generate ad revenue.
LLMs, for all their faults, are arguably better information aggregators at this point. That isn’t necessarily a ringing endorsement of AI, considering that they aren’t particularly good at searching either. It just illustrates how bad conventional search has become.
I wouldn’t interpret using an LLM to complete a task as inherently equivalent to students cheating. I’d argue that LLMs are simply another tool for finding, processing, and synthesizing information. If students can produce better results using those tools, perhaps we should be asking why we’re so determined to prevent them from doing so rather than examining the tools themselves.
And frankly, you can’t really cheat on homework. It’s homework, not a supervised examination. Students should be able to complete assignments using whatever resources are available to them. If the objective is to determine what students can accomplish independently, then schools should assess that through supervised examinations rather than take-home assignments.
More importantly, there’s a broader question about whether we’re assigning too much homework in the first place. Research has repeatedly found that its educational benefits depend on factors such as age, workload, and assignment quality. If an assignment provides little educational value beyond producing a completed worksheet, then perhaps the problem isn’t that students are using AI to complete it. Perhaps the assignment itself isn’t worth doing.
Have LLMs become better than Google?
Or has Google just gotten shittier than LLMs?
My SearXNG instance never lies to me, and returns results better than Google used to before they fully enshitified
Kagi is able to reach into Japanese websites, aggregate their information, and translate a summary of the contents for me. I used it to learn a bit about an old SNES kusoge, called Saiya no Densetu. Apparently you can get Goku to arrive before the Ginyu Force fight, but paradoxically, he has to be very low level.
This is information that a traditional search engine can’t easily grasp and present.
They make browser extensions for translations, and my SearXNG can index Japanese sites. I use it to find and download obscure Japanese music albums and ROMs. AI is a very inefficient way to achieve that result.
LLMs are better at most search tasks than Google has ever been. No contest, it is in no way close.
Truth. There is a lot of obscure searches that would go nowhere if I tried to use old-school searching. AI is the way forward when it comes to collecting lots of info and giving a cliff notes. Even better, the AI can then go into detail.
AI is the glasses of the information world: it lets people focus on getting shit done, every day.
I disagree
Aren’t most search engines just LLMs anyway these days?
No, a lot of them have LLMs integrated into their search engine, but they themselves are not LLMs.
The search engine I use (SearXNG) is what’s called a meta-search-engine, meaning it runs my query through several different search engines (which I can toggle on or off at will), then parses the results from all of the queried engines, strips out all of the slop bullshit, and returns me actually relevant links.
I think if you wanted to you could attach an LLM to a self-hosted SearXNG instance, but I’m not putting LLM fuckware on my system. I prefer my computations to be deterministic.
deleted by creator
It shows 100% for Frankenstein
deleted by creator
Lol, offloading your lack of criticism of a point to an llm.
Seems you’ve been cooking for longer than 10 minutes…
Eh. Go sit and spin.
deleted by creator
You used an AI service to determine if my comment was written by AI, and the service itself admits it can’t reliably determine that. Do you see the irony here? You literally used AI to guess whether I used AI and then treated that guess as fact. That’s some next-level nonsense.
I will say this however in my own defense not that I have to, I use Google keyboard which has a built-in AI editor it helps me to write long responses quickly.
I will use any and all tools that I deem necessary to complete any and all tasks regardless of your idiotic criticism.
“Using a compiler for ten minutes erodes your ability to write raw machine code”
This is… Unfortunately completely true. ☹️
Thank you! This makes me think maybe our brains reward themselves for finding easier ways to do something and LLMs become just that sometimes. But at the same time atrophying our existing skill. We need brain gyms like we do physical gyms.
Yeah my first thought looking at the title was literally… But I’m doing an extremely hard task while the dumb slop machine is doing an entirely different task.
I’m not just sitting there waiting around not thinking.
So how is that causing me to lose the ability to persist at hard things.
The article after reading it raises some good points but that head line is nonsense.
This is a really smart take on things.
Yah this should be pinned
Yah. Turtally.
Agreed, I tend to get more interested in topics and learn more than I expected, for new neural networks. I think it’s like any tool and using it right can be useful. Our brains can make new connections learning about different topics and how they are related, systems thinking and problem solving. We can search online and read the sources directly too, and verify more with increasing importance of the topic. For example, going to defend yourself in court, do a lot of research from quality sources and still reconsider lol. Just like large claims require large evidence, same idea for other resources including llms, and no need to avoid it like it’s some new Witch panic. The energy people use daily mindlessly absorbing video streams is more than text based llm use and follow up confirmations.
Seems like a biased study yea. Why not get someone to do something manually first without AI, then give them AI to see if they do it better or worse?