George Hotz | Programming | tinygrad refactoring (and

tiny corp is accepting new interns. more info on tinygrad.org and tinygrad discord | comma.ai is accepting interns comma.ai/jobs#open-positions

Pre-order tinybox buy.stripe.com/5kAaGL6lk9uX9nW144 more info on -> tinygrad.org | twitter.com/__tinygrad__/status/1729279842376613941/photo/1 | youtube.com/post/Ugkx49TlILe21dXuhJu6a74j5WCx3nGldqCC
from $1250 buy -> comma 3X comma.ai/shop/comma-3x | best ADAS system in the world openpilot.comma.ai | from $999 comma.ai/shop/body the future of people

github.com/tinygrad/tinygrad <- simple powerful deep learning framework

Support George by subscribing twitch.tv/subs/georgehotz | Follow George on twitter.com/realGeorgeHotz to be up to date | Read George's geohot.github.io/blog/

Chapters:
00:00:00 intro

00:01:35 responding to youtube comments

00:02:05 C. S. Lewis quote

00:03:05 physiology and sociology, wokeism, trans people

00:04:35 harvard, ivy league educational institutions

00:07:15 tesla cybertruck

00:08:40 communism, anarchy

00:10:15 based elon

00:10:40 Amouranth, Sky Bri

00:12:20 love, hate

00:13:35 refactor stream

00:14:05 beautiful.py

00:14:50 memory objects in opencl, buffers and images

00:16:00 dtype, cast_image, device hack

00:17:35 LRUAllocator

00:22:18 Clang operations, MallocAllocator

00:23:20 missing 1 required positional argument

00:27:40 this is the actual George's work

00:28:45 LazyBuffer problem

00:32:00 numpy

00:32:45 Alex

00:33:20 auto generated program, float

00:35:00 tinycorp second intern

00:36:40 TORCH=1 test_ops.py

00:38:15 adding cast

00:38:30 unreadable code

00:41:00 UnaryOps_CAST

00:42:10 DiskAllocator dtype

00:46:20 git push

00:47:00 letting everyone chat

00:47:30 be nice to people

00:47:50 what is AGI

00:48:20 why care about views

00:49:00 beautiful.py, tinygrad is a tensor library

00:51:00 ask good questions, anyone understand this?

00:54:45 memoryview cast

01:00:00 copyin function

01:03:50 buffer, JITRunner

01:05:00 The Device, LazyOp

01:10:40 renderer

01:12:25 current line count of tinygrad, hiball energy

01:18:00 questions? does this make sense?

01:20:40 FROM_BUFFER=1 examples coder.py

01:22:10 10 runtimes in tinygrad

01:26:50 computation, memory

01:31:40 where you call the kernels, ClangProgram, to_program, CompiledASTRunner

01:33:20 abstractions.py outdated use beautiful.py instead

01:33:50 MULACC trigger, matmul

01:37:35 git push improve docs

01:38:30 t8 tinybox spec

01:39:00 jax_pmatmul.py

01:39:35 WD_BLACK 1TB SN850X

01:40:30 bidirectional copy peak bandwidth GB/s

01:42:00 infiniband connection between two tinyboxes

01:44:10 up to 18 monitors into your tinybox

01:44:40 shipping to EU

01:45:20 preorder tinybox today

01:46:20 stupid question from non-sub

01:46:35 mlperf, how fast you can train the models

01:47:50 15k GPU hours

01:49:20 the cloud, low priority CPU

01:50:10 tinybox for common user or business, secret price

01:51:10 tinybox wattage

01:55:20 Alex brining tea

01:57:10 hashcat example

02:06:25 4090 vs tinybox hashcat

02:09:40 Alex bringing lunch

02:11:45 hip for hashcat bug

02:12:20 best coin to mine with gpus

02:13:35 amd 8000

02:14:30 advent of code day one speedrun

02:19:20 AoC part 2, asking Quentin for help

02:26:00 write a regex to replace

02:30:20 good programming style

02:31:00 struggle in python console

02:37:15 reducing the lines of code

02:50:55 compiling

02:57:50 memory usage bug

03:06:00 external_test_alloc_all.py

03:11:40 analyze the issue in the comments

03:13:55 why tinygrad has to be so tiny

03:14:30 changing culture, gpt-fast

03:17:05 27 tinyboxes = person

03:17:25 teenyboxes = gaming computer

03:18:20 pro esports player

03:19:10 1Torch, unspecified launch failure

03:24:30 ???, OpenLLaMA, Nvidia

03:27:50 if George was CEO of OpenAI

03:30:25 opensource weights

03:30:50 company that lasts 1000 years

03:31:30 top 10 biggest companies

03:32:15 Apple M3 fastest single thread cpu

03:33:30 Apple GPU

03:35:50 high end M3 Max, don't buy low end M3

03:37:25 5 M3 Max or 1 tinybox

03:38:20 based Apple getting rid of touchbar

03:38:45 spec of tinybox

03:39:10 wokism, truth crime interrogation footage

You're the shit! Remember SPM said never change

Always very nice for motivation these streams / reruns. Thanks G!

Regarding the cs lewis quote on tyranny.. reminds me of how Slavoj Zizek bit on the strict father vs the liberal, or 'Non-authoritarian father' that makes you have to want it.. thereby not even granting you the enjoyment of doing something while still maintaining your autonomous nature.

When do you plan to start letting AI write the code for you?

with all the focus on language, do you, George, take literature/literary analysis/art seriously? feels like few people in technology do (they just quote the odd sci-fi novel)

You seem tired. Get a real job.

based top developer 😭

I liked the refactor content. Great to see you facing similar problems to my day to day just in a different code base.

The documentation section was good to going to go through it myself and see if I can understand it.

yea buddy LFG!!

what's your preferred way to link mac + linux for file sharing?

Stu studio😅

I love this man

Hey George, what you think about using PyCharm?

geo, if you read this, just know, you a bro

What's your view on the Shane Gillis Joke that Biden turns into a roomba when he finishes a speech? Literal? Metaphor? Funny or not funny?

We love you George the way you are be. I disagree with you on the anarchy topic, best form of anarchy is "anarcho capitalism" bined with privatization. I guess your problem with this is, that you view it on a big state like USA. But imigine it how Germany was 1500 Google: "germany 1500 map" it has multiple small states. Those states could choose for themself which economy form they would like to have or which political system. In that way a free market of (economies and political system) will envolved. And a free market will always choose the best as winners

what kind porn do you watch?

Hallelujah!!!!

Awesome stream (just in case you are reading this George).

George, you should talk about the architecture of Tinygrad more while coding. A 'big picture' perspective would help a ton.

An open letter to Geohotz

In the realm of streaming, where pixels ignite,
There's a virtuoso whose talent shines bright.
Geohotz, the master of digital art,
Guiding us through codes with a genius impart.

With nimble fingers, he dances on keys,
Weaving his magic in zeros and threes.
His streams, a portal to a world unknown,
A universe where technology is sown.

But alas, dear Geohotz, a plea we implore,
For the fonts on your monitor, we long to explore.
In the vast expanse of your coding domain,
The letters grow tiny, causing us strain.

We marvel at the brilliance you impart,
But struggle to decipher the words, in part.
Oh, Geohotz, we beseech you, with utmost respect,
Please make the fonts bigger, a simple request.

Let your code be readable, clear as the sky,
So we may follow your journey, never shy.
For your insights and knowledge, we yearn to glean,
But the tiny fonts leave us squinting, unseen.

So, kind Geohotz, in your streaming abode,
Enlarge the fonts, let the words freely flow.
Illuminate the screen with letters bold and grand,
And we'll join you, enthralled, in this digital land.

For in your hands, dear Geohotz, lies the power,
To bridge the gap between us, hour by hour.
With bigger fonts, our connection will grow,
In this streaming symphony, together we'll glow.

So hear our plea, Geohotz, and let it be known,
With bigger fonts, our hearts will be sown.
We'll journey with you through your streaming endeavor,
Guided by your genius, now and forever.

You're planning on playing Jax on top? Nice!!!