IBM
George Hotz | Programming | tinygrad refactoring (and
George Hotz | Programming | tinygrad refactoring (and maybe some JAX) | tinygrad.org | tinybox
#George #Hotz #Programming #tinygrad #refactoring
“george hotz archive”
Date of the stream 2 Dec 2023.
from $1250 buy & best ADAS system in the world
Live-stream chat added as Subtitles/CC – English (Twitch Chat) – at the bottom – Show Transcript
Sources:
–
-…
source
To see the full content, share this page by clicking one of the buttons below |
tiny corp is accepting new interns. more info on tinygrad.org and tinygrad discord | comma.ai is accepting interns comma.ai/jobs#open-positions
Pre-order tinybox buy.stripe.com/5kAaGL6lk9uX9nW144 more info on -> tinygrad.org | twitter.com/__tinygrad__/status/1729279842376613941/photo/1 | youtube.com/post/Ugkx49TlILe21dXuhJu6a74j5WCx3nGldqCC
from $1250 buy -> comma 3X comma.ai/shop/comma-3x | best ADAS system in the world openpilot.comma.ai | from $999 comma.ai/shop/body the future of people
github.com/tinygrad/tinygrad <- simple powerful deep learning framework
Support George by subscribing twitch.tv/subs/georgehotz | Follow George on twitter.com/realGeorgeHotz to be up to date | Read George's geohot.github.io/blog/
Chapters:
00:00:00 intro
00:01:35 responding to youtube comments
00:02:05 C. S. Lewis quote
00:03:05 physiology and sociology, wokeism, trans people
00:04:35 harvard, ivy league educational institutions
00:07:15 tesla cybertruck
00:08:40 communism, anarchy
00:10:15 based elon
00:10:40 Amouranth, Sky Bri
00:12:20 love, hate
00:13:35 refactor stream
00:14:05 beautiful.py
00:14:50 memory objects in opencl, buffers and images
00:16:00 dtype, cast_image, device hack
00:17:35 LRUAllocator
00:22:18 Clang operations, MallocAllocator
00:23:20 missing 1 required positional argument
00:27:40 this is the actual George's work
00:28:45 LazyBuffer problem
00:32:00 numpy
00:32:45 Alex
00:33:20 auto generated program, float
00:35:00 tinycorp second intern
00:36:40 TORCH=1 test_ops.py
00:38:15 adding cast
00:38:30 unreadable code
00:41:00 UnaryOps_CAST
00:42:10 DiskAllocator dtype
00:46:20 git push
00:47:00 letting everyone chat
00:47:30 be nice to people
00:47:50 what is AGI
00:48:20 why care about views
00:49:00 beautiful.py, tinygrad is a tensor library
00:51:00 ask good questions, anyone understand this?
00:54:45 memoryview cast
01:00:00 copyin function
01:03:50 buffer, JITRunner
01:05:00 The Device, LazyOp
01:10:40 renderer
01:12:25 current line count of tinygrad, hiball energy
01:18:00 questions? does this make sense?
01:20:40 FROM_BUFFER=1 examples coder.py
01:22:10 10 runtimes in tinygrad
01:26:50 computation, memory
01:31:40 where you call the kernels, ClangProgram, to_program, CompiledASTRunner
01:33:20 abstractions.py outdated use beautiful.py instead
01:33:50 MULACC trigger, matmul
01:37:35 git push improve docs
01:38:30 t8 tinybox spec
01:39:00 jax_pmatmul.py
01:39:35 WD_BLACK 1TB SN850X
01:40:30 bidirectional copy peak bandwidth GB/s
01:42:00 infiniband connection between two tinyboxes
01:44:10 up to 18 monitors into your tinybox
01:44:40 shipping to EU
01:45:20 preorder tinybox today
01:46:20 stupid question from non-sub
01:46:35 mlperf, how fast you can train the models
01:47:50 15k GPU hours
01:49:20 the cloud, low priority CPU
01:50:10 tinybox for common user or business, secret price
01:51:10 tinybox wattage
01:55:20 Alex brining tea
01:57:10 hashcat example
02:06:25 4090 vs tinybox hashcat
02:09:40 Alex bringing lunch
02:11:45 hip for hashcat bug
02:12:20 best coin to mine with gpus
02:13:35 amd 8000
02:14:30 advent of code day one speedrun
02:19:20 AoC part 2, asking Quentin for help
02:26:00 write a regex to replace
02:30:20 good programming style
02:31:00 struggle in python console
02:37:15 reducing the lines of code
02:50:55 compiling
02:57:50 memory usage bug
03:06:00 external_test_alloc_all.py
03:11:40 analyze the issue in the comments
03:13:55 why tinygrad has to be so tiny
03:14:30 changing culture, gpt-fast
03:17:05 27 tinyboxes = person
03:17:25 teenyboxes = gaming computer
03:18:20 pro esports player
03:19:10 1Torch, unspecified launch failure
03:24:30 ???, OpenLLaMA, Nvidia
03:27:50 if George was CEO of OpenAI
03:30:25 opensource weights
03:30:50 company that lasts 1000 years
03:31:30 top 10 biggest companies
03:32:15 Apple M3 fastest single thread cpu
03:33:30 Apple GPU
03:35:50 high end M3 Max, don't buy low end M3
03:37:25 5 M3 Max or 1 tinybox
03:38:20 based Apple getting rid of touchbar
03:38:45 spec of tinybox
03:39:10 wokism, truth crime interrogation footage
You're the shit! Remember what SPM said never change
You're the shit! Remember SPM said never change
You should develop a K.I.T.T computer for cars. Seriously! Do it! Be the first!
Always very nice for motivation these streams / reruns. Thanks G!
I can't run it on my pentium 4, please Qwen-72B on a tinybox, with tinygrad
Regarding the cs lewis quote on tyranny.. reminds me of how Slavoj Zizek bit on the strict father vs the liberal, or 'Non-authoritarian father' that makes you have to want it.. thereby not even granting you the enjoyment of doing something while still maintaining your autonomous nature.
0:45: 🗨️ Casual morning chat with a diverse group of viewers discussing various topics.
7:37: 🚗 Discussion about the Cybertruck and education system.
25:52: 🎮 A live stream chat discussing programming, subscriptions, and gifting subs.
53:56: ⚙️ Discussion on CPU performance, abstraction in programming, and use of AI accelerators in CPUs.
1:46:07: 💻 Discussion about computer hardware and AI technology.
1:55:53: 🎉 Excited chat reacts to the presence of a woman on the stream.
2:08:13: ⚙️ Discussion on hashcat, running multiple models locally, and AMD GPU firmware issues.
2:23:46: 🤖 Discussion about regex and AI capabilities in solving problems.
2:38:19: ⚙️ Discussion and coding session on various programming topics.
2:55:48: 🤔 A discussion about computer technology and humor in the online community.
3:10:42: 🤖 Discussion on AGI achievement, code testing, and GPU usage.
3:24:38: 🤖 Viewers engage in chat about AI language and coding.
3:36:34: 💻 Discussion about the performance, use, and potential of the tinybox, with some technical details and user questions.
Made by TammyAIsummarizer
When do you plan to start letting AI write the code for you?
“Who do we hate when we hate wokeism? Who was at the root of all wokeist ideology” George will not like the answer lol
with all the focus on language, do you, George, take literature/literary analysis/art seriously? feels like few people in technology do (they just quote the odd sci-fi novel)
tinygrad website says you have over 9000 github stars, which is true, but you currently have like 21k stars, so you could say "over 20,000 github stars"
You seem tired. Get a real job.
you may be rick and brilliant, but i disabled by ad block for you. two full time adverts that i couldn't care less about. you are a brilliant mind that puts me asleep in a way that makes me feel better about myself and humanity
based top developer 😭
an uncultured person doesn't read Banks, everything he ever put out before sadly dying of cancer is high grade reading. even the non Culture books. glad people are still discovering one of my all time favorite writers.
I liked the refactor content. Great to see you facing similar problems to my day to day just in a different code base.
The documentation section was good to going to go through it myself and see if I can understand it.
Not sure why you were “rejected” from “the system”. I also dropped out of college and I am now doing R&D at MIT as an employee of the college… I can’t speak for Harvard, but I’m not sure why you’re so adamantly against “the Ivy League system.” My experience shows they really don’t care about your background if they think you’re doing worthwhile work…
yea buddy LFG!!
HOLY best part 1:55:20 🤣
what's your preferred way to link mac + linux for file sharing?
I want to create a learning algorithm with just NAND-gates by reducing gates (compression). Is this a good idea George?
Stu studio😅
The goat
I love this man
Grateful for the content, can you talk a little bit about the future (next 3-5 years) of programming and IT jobs in general, I am very curious to hear that from you, cheers!
Hey George, what you think about using PyCharm?
I don't know how much universities push wokism. I feel like it started when everyone realized how effective cancel culture was during MeToo. Surprised no one ever brings that up.
geo, if you read this, just know, you a bro
I thought to comment, "Your stream gives me eye strain," but thought further to the conclusion that having an interest in computing gives me eye strain and your stream is among the most strenuous, which I appreciate.
What's your view on the Shane Gillis Joke that Biden turns into a roomba when he finishes a speech? Literal? Metaphor? Funny or not funny?
Haha, yeah he's Irish. It's not like he wears an extremely tiny hat in private or anything. Don't listen to this guy, it's a double-bluff.
We love you George the way you are be. I disagree with you on the anarchy topic, best form of anarchy is "anarcho capitalism" bined with privatization. I guess your problem with this is, that you view it on a big state like USA. But imigine it how Germany was 1500 Google: "germany 1500 map" it has multiple small states. Those states could choose for themself which economy form they would like to have or which political system. In that way a free market of (economies and political system) will envolved. And a free market will always choose the best as winners
How does he not get sick of programming?
what kind porn do you watch?
I do appreciate that the captions show the Twitch chat but it may be nice to have a floating window one day on stream since many watch the VODs. The captions disappear at fixed intervals it seems and when people post more than "pog" etc. it can be hard to follow.
Hallelujah!!!!
this is actually a decent introduction to ctypes as well, I am liking it.
Awesome stream (just in case you are reading this George).
7:00
George, you should talk about the architecture of Tinygrad more while coding. A 'big picture' perspective would help a ton.
😂😂the simping is real
An open letter to Geohotz
In the realm of streaming, where pixels ignite,
There's a virtuoso whose talent shines bright.
Geohotz, the master of digital art,
Guiding us through codes with a genius impart.
With nimble fingers, he dances on keys,
Weaving his magic in zeros and threes.
His streams, a portal to a world unknown,
A universe where technology is sown.
But alas, dear Geohotz, a plea we implore,
For the fonts on your monitor, we long to explore.
In the vast expanse of your coding domain,
The letters grow tiny, causing us strain.
We marvel at the brilliance you impart,
But struggle to decipher the words, in part.
Oh, Geohotz, we beseech you, with utmost respect,
Please make the fonts bigger, a simple request.
Let your code be readable, clear as the sky,
So we may follow your journey, never shy.
For your insights and knowledge, we yearn to glean,
But the tiny fonts leave us squinting, unseen.
So, kind Geohotz, in your streaming abode,
Enlarge the fonts, let the words freely flow.
Illuminate the screen with letters bold and grand,
And we'll join you, enthralled, in this digital land.
For in your hands, dear Geohotz, lies the power,
To bridge the gap between us, hour by hour.
With bigger fonts, our connection will grow,
In this streaming symphony, together we'll glow.
So hear our plea, Geohotz, and let it be known,
With bigger fonts, our hearts will be sown.
We'll journey with you through your streaming endeavor,
Guided by your genius, now and forever.
Hi geroge UwU
You're planning on playing Jax on top? Nice!!!