← go back
LOCAL COMPUTE AND THE FUTURE OF SCHOOL
august 22, 2023
What will the future of personal assistants look like? Will people have them inside of their homes, inside of some type of server? Or will AIs live in the cloud, stored away in some company's mega servers?
I think that I would prefer the former—everyone owning their own AI. But this raises another question: In what physical form will AIs primarily exist? Should it be a standalone handheld device, some sort of ASIC specifically for a certain model? Will it be like the iPod? Will Apple upgrade Siri and have it live there?
I've been thinking about making some type of device that runs Meta's LLAMA. It's an Orange Pi 5 with the RK3588S and 8GB of RAM, and it includes 6 TOPS inside of its neural engine. For $99, it's an insane deal. I just ordered a case, power supply, and OLED display for it. It arrives tomorrow. I'm going to make a personal LLM node. I want to have AI friends.
And I think you will too. One day you'll hop onto your computer and the AI will greet you. You can tell it about your day. You can hash out your latest dilemmas and get good advice. Then you can tell it to read through your emails and texts, and then notify you of anything important—anything with information—anything with signal.
But what I'm really struggling with lately is that you need so much compute in order to make something even remotely competitive to GPT-4. How in the world am I supposed to get that much compute? I'm not even sure where to start if I raised an enormous round of funding. I have to research more.
As I was blabbering about at the start of this text, I'm struggling to figure out what the form factor of AIs will be. What will the normal person want? I'm actually pretty afraid of only certain people having access to ultra-intelligent AIs. There needs to be a model that can work offline or connect to the internet. It'll sift through unnecessary emails. It'll get rid of the boilerplate of life so you can do what you love.
There is SO MUCH noise insocial media. Is there a way to make a recommendation system that maximizes information and entropy while reducing noise? Click on one Mr. Beast video, go to the comments, and notice how it's the same information repeated. Opinions are noise. I want information. I want truth.
Give me those two things, please. Then we can talk about opinions and how to shape the best possible future.
But one thing going for me is that I am crazy enough to think that I can change the world. History always repeats itself, too. And the kid in the garage always seems to be the victor. Being small, nimble, and with perfect execution and an insanely useful product is more advantageous than being big and seemingly indestructible.
Steve Jobs has to be my GOAT. I was reading his unfinished book called Make Something Great. There are so many gems in it. I didn't even finish half of it, but I was writing down so many things. One of my friends during my summer internship asked me if I would rather have a conversation with Steve Jobs or $500K. I chose Steve Jobs.
Am I crazy for that? Who would you rather have a conversation with instead of getting $500K in your pocket instantly?
Today my brother in high school told me that they don't read 1984 by George Orwell anymore. Whose idea was that? Are they trying to shape the future of kids by not teaching them about the dangers of over-surveillance?
I don't know about you, but that seems like a foundationally important book.
There's a great frame from Star Wars of Yoda and Obi-Wan Kenobi teaching a group of Padawans. However, the Padawans all have some type of helmet on that covers their entire field of view, and they have teeny circular floating devices next to them. I actually think that this is what schools might look like in the future. There will be a master teacher, but all kids will have their VR/AR goggles on with an AI friend that teaches them in exactly the way that they need.