18 Comments

"I could sit in front of students, give Chatbots prompts, and show everyone my screen. But that seems silly.

Better to have students do the prompting. "

Are you implying we don't need teachers anymore?

Expand full comment
founding
Mar 20, 2023Liked by Arnold Kling

this is a fantastic idea. Got me thinking about ways to engage the people at my company with ChatGPT. I could imagine doing something similar as a training exercise that gets people familiar with the tech.

Expand full comment

I like this idea. I think it would be good for students and teachers alike. Embracing AI in this way provides a good opportunity for students to learn how to best use the tech, lessons like the importance of asking the right questions and checking sources. And if teachers don't utilize these tools, they won't be able to take advantage of what AI has to offer or prevent outcomes they don't like, such as cheating on exams.

Expand full comment

'Autodidact' is doing some heavy lifting here. Autodidact means self-teaching, but actually, everybody is self-teaching when they actually care about learning something. Practically everyone has gone on youtube to watch an instructional video on how to do something.

Autodidacts are more self-motivatatng than self teaching ("auto-proponits" maybe), and so will tend to figure out how to make best use of whatever tools become available to accomplish their learning goals.

But for most students (at any level of cognitive ability) it's motivation, not tools or techniques, that is the key issue. The problem is not lack of tools, access, or resources, which have been around for a long time in powerful forms and at low prices which would have astounded preceding generations. The problem is shaping situations and incentives to nudge the marginally un-motivated student to *want* to learn.

My hunch is that at this point we run into issues of hard-wired social psychology that make it difficult to substitute those social influences with computer tools. For example, it is instinctively easier for a member of 'the audience' to pay attention to some focal 'performance' when that member subconsciously picks up the subtle cues that the people around him are also paying close attention. It is easier to do what one imagines a teacher or professor or mentor wants (or what would impress them as an opportunity to show off) when one subconsciously calculates that affilitating with an authority figure or high-status individual would likely have personal benefits down the line.

Chatbots don't have status, can't do anything for you, don't make you cool or sexy when you tell people you use them. Interacting with a chatbot - in what is bound to be a typically solitary fashion - doesn't provide those social cues or incentives, and thus, doesn't help coach or motivate (at least, not yet, maybe soon!)

So, the autodidacts / autoproponits will indeed derive a lot of advantage from this new powerful tool, just like they did with all the previous powerful tools. But the other students will just use it like a search engine as an even faster way to get the answers to the homework or test or lines for the essay.

Perversely, I suspect that being even more able to outsource research, learning, and now even impressive composition to the chatbots will actually undermine the retention of actual skills or knowledge, just like people who were once able to use paper maps to navigate around a city found that they couldn't do it anymore after years of relying on smartphone GPS apps.

Expand full comment
Mar 20, 2023Liked by Arnold Kling

Great ideas! One of the most exciting uses I’ve found for ChatGPT is just, as you suggest, getting into a dialog with it about interesting things, asking for bullet points, outlines, timelines, compare-and-contrast, sources, experts, etc. It’s a tool made exactly for the kind of active learning that aligns with effective learning.

I find this stuff so incredible, and I can’t imagine that the world we live in is going to be transformed by these tools. I’m trying to figure out why that isn’t the case, and how to put the brakes and be skeptical of my own excitment. But every time I interact with ChatGPT, Bing, Midjourney, etc. I’m just completely blown away.

Expand full comment

This is worth repeating: “I think that we were already in a technological environment that favors autodidacts over traditional classroom learning. Chatbots take that to the next level.”

Education is a foundational component of future development and it seems as we a poised for exponential improvement in learning. Everyone will benefit from this.

Nevertheless, the best and the brightest will reap most of the rewards and that will certainly bring out the “equality thugs” to bemoan this advancement.

Expand full comment

This is maybe not quite as ideal as a "Young Lady's Primer" - but far far more realistic. Could even be done, technically now.

Using the hack-a-thon model is a fantastic, maybe paradigm changing idea.

I can easily imaging groups of home-schoolers trying this out.

Even have school teams, competing with other teams, and voting on which ones they think are the best at the end (ranked order 1-8).

I do think some "teaching how to use a chatBot" examples by the teacher would be good.

Expand full comment

Ethan Mollick has written a number of posts on this topic. For example: https://oneusefulthing.substack.com/p/using-ai-to-make-teaching-easier . As have, I believe Tyler Cowen &or Alex Tabarrok.

Expand full comment

I note that you don't bring up the problem of chatbots being optimized to mimic human writing, not presenting a range of "true" information or accurate representations of it. Even prompting to answer as though it were a top economist is roughly as functional as pointing an undergrad to a wall of books by "top economists" and telling them to write an answer to your question. Neither one actually understands the answers and are just copy/pasting things that seem plausible. If the answer is internally contradictory, oh well. If it just makes stuff up to make it sound better, oh well.

Maybe an even better example is when kids ask their parents questions they don't know the answer to, and the parents just make something up that seems plausible. Terribly funny when Calvin's dad does it, but not so great if people are getting large amounts of information that way. Checking the sources is important, if you get them, but how many people are actually ever going to do that? Hell, peer reviewers never check the citations in academic papers it seems, so...

Expand full comment

This would be fun but I think it accomplishes a different task than standard lectures do, and it also flattens critical thinking as most students will pick up the "standard" views and facts, and there really wouldn't be time for reflection and asking questions.

Expand full comment

Cool idea!

Expand full comment

How will you avoid the hallucination problem?

Expand full comment

"I am optimistic that chatbots can prove to be the most important innovation in education in my lifetime. "

I'm surprised by this much optimism coming from you. Regardless, education is mostly about the student being interested. This will help some be more interested. Great. Why will it be significantly different in importance from Coursera,etc., traditional classes taught online, Babbel,etc., YouTubes, web searches, Wikipedia, etc.?

Why you think learning in 8 hours with a chatbot would be greater than many more hours over ~12 weeks using other methods?

And given your disdain for universities, you putting the chatbot in a classroom kind of blows my mind.

Expand full comment

I will just repeat what I wrote on this substack a few months ago- the LLMs will be utilized effectively by the most talented people, and the rest of the people will use them as crutches allowing further atrophy of human capital.

Expand full comment