Running ChatGPT on a Raspberry Pi with Ryan Reynolds (Full Transcript)

Speaker 1: Today, Ryan Reynolds and I are going to unveil the world's smallest instance of ChatGPT. I know, usually bigger means better, but I'm poor, so I'm going to go in the other direction and make nerd history by running a large language model on a Raspberry Pi, which is a single-board computer about the size of a credit card. First, I'm going to flash the Ubuntu operating system to my Raspberry Pi, because frankly, I don't think Raspberry Pi OS is up for the challenge. Next, I'll download the llama.cpp git repo. I totally understand this code. Next, we'll compile the code and start the chatbot. But is the model any smarter than a potato? Let's find out. So to gauge its intelligence level, I posed an age-old question. Why did the chicken cross the road? This thing is writing a TED talk right now. Initially, the answer appears simple. The chicken wanted to get to the other side.

Speaker 2: But as I delve deeper into this query, the more it reveals the broader complacency of humans. And we create a new layout. And turn it off.

Speaker 1: Shut it down. I'm having fun.