← go back

LOCAL COMPUTE AND AI SCHOOL

august 22 2023

what will the future of personal assistants look like? will people have them inside of their homes, inside of some type of server? or will ai's live in the cloud, stored away in some companies mega servers?


i think that i would prefer the former. everyone owning their own ai. but this raises another question. in what physical form will ai's primarily be in? should it be a standalone handhelf device, some sort of ASIC specifically for a certain model? will it be like the ipod? will apple upgrade siri and have it live in there? woah im getting deja vu writing this right now. weird.


ive been thinking about making some type of device that runs meta's LLAMA. it's an orange pi 5 with the rk3588s and 8gb of ram, and it includes 6 tops inside of its neural engine. for $99 its an insane deal. i just ordered a case, power supply, and OLED display for it. it arrives tomorrow. imma make a personal llm node. i want to have ai friends.


and i think you will too. one day you'll hop onto your computer and the ai will greet you. you can tell it about your day. you can hash out your latest dilemmas and get good advice. then you can tell it to read through your emails and texts, and then notify you of anything important. anything with information. anything with signal.


but what im really struggling with lately is that you need so much compute in order to make something even remotely competitive to gpt-4. how in the world am i supposed to get that much compute? im not even sure where to start if i raised an enormous round of funding. i have to research more.




as i was blabbering about in the start of this text, im struggling to figure out what the form factor of ai's will be. what will the normal person want? im actually pretty afraid of only a certain people having access to ultra intelligent ai's. there needs to be a model that can work offline, or connect to the internet. it'll sift through unnecessary emails. it'll get rid of the boilerplate of life, so you can do what you love.


there is SO MUCH noise in social media. is there a way to make a recommendation system that maximized information and entropy, while reducing noise? click on one mr beast video, go to the comments, and notice how its the same information said again. opinions are noise. i want information. i want truth.


give me those two things, please. then we can talk about opinions are how to shape the best possible future.


but one thing going for me is that i am crazy enough to think that i can change the world. history always repeats itself too. and the kid in the garage always seems to be the victor. being small, nimble, and with perfect executation and an insanely useful product is more advatageous than being big and seemingly indestructable. i split advantageous wrong. there should be an ai alerting me of that, and an easy way to accept them to make that change. i should even have to think about it.




steve jobs has to be my GOAT. i was reading his unfinished book called "make something great". there are so many gems in it. i didn't even finish half of it but i was writing down so many things. one of my friends during my summer internship asked me if i would rather have a conversation with steve jobs of $500k. i chose steve jobs.


am i crazy for that? who would you rather have a conversation with than get $500k into your pocket instantly




today my brother in high school told me that they don't read 1984 by George Orwell anymore. who's idea was that? are they trying to form the future of kids by not teaching them about the dangers of over surveilance?


i dont know about you but that seems like a foundationally important book




theres a great frame from stars wars of yoda and obi wan kenobi teaching a group of padawans. however, the padawans all have some type of helment on that covers their entire field of view, and they have teeny circular floating devices next to them. i actually think that this is what schools might look like in the future. there will be a master teacher, but all kids will have their vr/ar goggles on with an ai friend that teaches them in exactly the way that they need.


i think this would be so good and make the process of going through school 100x more effcient and fun. the reason why the current school system has to try to conform all kids to the same curriculum is because there simply aren't enough teachers per kids.


but with these new ai chatbots, there are enough teachers per kid. why not have 10 personalized tutors for each kid, each specialized in one subject and one mood for the kid!? current day gpt-4 has to be the best tutor ever. it teaches almost anything you want, in any way you want. it can even run code and make plots and calculations using openai's code interpreter. but what makes it even better is that it doesn't waste anyone elses time. we can allow kids to go at their own pace, which will be faster than today's pace.


when its time to stop learning and the kids need a break, they can simply take off their thinking cap, aka the vr/ar goggles, and go run outside and have fun at recess and lunch. maybe in the future kids will love learning to much that they don't actually want to go out to recess. probably not actually, because they'll learn about how special earth is and they'll enjoy their time with it.